[ 667.968057] env[69789]: INFO neutron.common.config [-] Logging enabled! [ 667.968560] env[69789]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev62 [ 667.968909] env[69789]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69789) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 667.969222] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 667.969336] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 667.970142] env[69789]: WARNING oslo_policy.policy [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 667.970360] env[69789]: WARNING oslo_policy.policy [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 667.971875] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] VMware NSXv3 Agent initialized successfully. [ 667.972244] env[69789]: DEBUG oslo_concurrency.lockutils [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] Acquiring lock "singleton_lock" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.972407] env[69789]: DEBUG oslo_concurrency.lockutils [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] Acquired lock "singleton_lock" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.972587] env[69789]: DEBUG oslo_concurrency.lockutils [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] Releasing lock "singleton_lock" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.972872] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] Full set of CONF: {{(pid=69789) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 667.972991] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ******************************************************************************** {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 667.973115] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] Configuration options gathered from: {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 667.973519] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 667.973697] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 667.973810] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ================================================================================ {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 667.973989] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] agent_down_time = 75 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.974152] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] allow_automatic_dhcp_failover = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.974321] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] allow_bulk = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.974478] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] api_extensions_path = {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.974626] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] api_paste_config = api-paste.ini {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.974772] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] auth_strategy = keystone {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.974882] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] backdoor_port = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.974989] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] backdoor_socket = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.975149] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] backlog = 4096 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.975292] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] base_mac = fa:16:3e:00:00:00 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.975453] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] bind_host = 0.0.0.0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.975597] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] bind_port = 9696 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.975739] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] client_socket_timeout = 900 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.975881] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] config_dir = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.975994] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.976149] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] config_source = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.976295] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] control_exchange = neutron {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.976438] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] core_plugin = ml2 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.976581] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] debug = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.976724] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] default_availability_zones = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.976934] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.977090] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] dhcp_agent_notification = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.977231] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] dhcp_agents_per_network = 1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.977369] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] dhcp_lease_duration = 86400 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.977574] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] dhcp_load_type = networks {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.977651] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] dns_domain = openstacklocal {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.977789] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.978065] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] enable_default_route_bfd = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.978065] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] enable_default_route_ecmp = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.978193] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] enable_dvr = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.978330] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] enable_new_agents = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.978465] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.978596] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] enable_signals = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.978729] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] enable_traditional_dhcp = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.978889] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] external_dns_driver = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.978998] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] filter_validation = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.979140] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] global_physnet_mtu = 8950 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.979278] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] graceful_shutdown_timeout = 60 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.979461] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] host = cpu-1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.979607] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] host_dvr_for_dhcp = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.979747] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] http_retries = 3 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.979926] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] instance_format = [instance: %(uuid)s] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.980044] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.980191] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ipam_driver = internal {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.980327] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ipv6_pd_enabled = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.980467] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] l3_ha = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.980645] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.980748] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] l3_ha_network_physical_name = {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.980889] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] l3_ha_network_type = {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.981043] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] log_color = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.981187] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] log_config_append = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.981361] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.981496] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] log_dir = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.981630] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] log_file = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.981740] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] log_options = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.981879] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] log_rotate_interval = 1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.982032] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] log_rotate_interval_type = days {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.982176] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] log_rotation_type = none {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.982287] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.982396] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.982545] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.982680] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.982788] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.982926] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] max_dns_nameservers = 5 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.983085] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] max_header_line = 16384 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.983219] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] max_l3_agents_per_router = 3 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.983387] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] max_logfile_count = 30 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.983534] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] max_logfile_size_mb = 200 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.983671] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] max_subnet_host_routes = 20 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.983813] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] my_ip = 10.180.1.21 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.983977] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] my_ipv6 = ::1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.984131] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] network_auto_schedule = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.984601] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] network_link_prefix = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.984601] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.984601] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] notify_nova_on_port_data_changes = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.984702] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] notify_nova_on_port_status_changes = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.984848] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] pagination_max_limit = -1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.984988] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] publish_errors = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.985140] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] rate_limit_burst = 0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.985286] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] rate_limit_except_level = CRITICAL {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.985460] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] rate_limit_interval = 0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.985608] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] retry_until_window = 30 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.985750] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] router_distributed = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.985888] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] rpc_resources_processing_step = 20 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.986038] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] rpc_response_max_timeout = 600 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.986181] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] rpc_response_timeout = 60 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.986319] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] send_events_interval = 2 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.986475] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] service_plugins = ['router'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.986624] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] setproctitle = on {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.986754] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] shell_completion = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.986896] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] state_path = /opt/stack/data/neutron {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.987054] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] syslog_log_facility = LOG_USER {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.987199] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] tcp_keepidle = 600 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.987346] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] transport_url = **** {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.987490] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] use_journal = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.987629] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] use_json = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.987767] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] use_ssl = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.987953] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] use_stderr = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.988053] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] use_syslog = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.988198] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] vlan_qinq = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.988334] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] vlan_transparent = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.988471] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] watch_log_file = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.988609] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] wsgi_default_pool_size = 100 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.988744] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] wsgi_keep_alive = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.988890] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.989047] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] wsgi_server_debug = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 667.989208] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_concurrency.disable_process_locking = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.989368] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.989517] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.989660] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.989807] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.989952] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.990106] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.990261] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.connection_string = messaging:// {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.990409] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.enabled = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.990557] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.es_doc_type = notification {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.990756] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.es_scroll_size = 10000 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.990851] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.es_scroll_time = 2m {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.991061] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.filter_error_trace = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.991223] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.hmac_keys = **** {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.991379] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.sentinel_service_name = mymaster {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.991527] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.socket_timeout = 0.1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.991671] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.trace_requests = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.991810] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler.trace_sqlalchemy = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.991970] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler_jaeger.process_tags = {} {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.992125] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler_jaeger.service_name_prefix = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.992267] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] profiler_otlp.service_name_prefix = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.992431] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.enforce_new_defaults = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.992696] env[69789]: WARNING oslo_config.cfg [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 667.992852] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.enforce_scope = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.993024] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.policy_default_rule = default {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.993177] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.993349] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.993506] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.993649] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.993791] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.993928] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.994079] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.994230] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_policy.remote_timeout = 60.0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.994433] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.994583] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] agent.extensions = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.994735] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.994884] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] service_providers.service_provider = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.995049] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.default_quota = -1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.995205] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.995348] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.quota_floatingip = 50 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.995497] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.quota_network = 100 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.995638] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.quota_port = 500 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.995778] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.995918] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.quota_router = 10 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.996071] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.quota_security_group = 10 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.996215] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.996354] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.quota_subnet = 100 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.996499] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] QUOTAS.track_quota_usage = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.996658] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.996799] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep.group = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.996938] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep.helper_command = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.997096] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep.log_daemon_traceback = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.997247] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.997425] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep.thread_pool_size = 8 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.997591] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep.user = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.997747] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.997888] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_dhcp_release.group = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.998040] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_dhcp_release.helper_command = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.998185] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.998330] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.998473] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.998611] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_dhcp_release.user = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.998757] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.998892] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_ovs_vsctl.group = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.999038] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_ovs_vsctl.helper_command = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.999179] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.999323] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.999466] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.999603] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_ovs_vsctl.user = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.999748] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_namespace.capabilities = [21] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 667.999884] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_namespace.group = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.000028] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_namespace.helper_command = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.000173] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_namespace.log_daemon_traceback = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.000316] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.000458] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_namespace.thread_pool_size = 8 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.000596] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_namespace.user = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.000744] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_conntrack.capabilities = [12] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.000879] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_conntrack.group = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.001028] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_conntrack.helper_command = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.001160] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_conntrack.log_daemon_traceback = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.001341] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.001474] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.001606] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_conntrack.user = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.001752] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_link.capabilities = [12, 21] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.001887] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_link.group = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.002033] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_link.helper_command = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.002177] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_link.log_daemon_traceback = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.002320] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.002461] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_link.thread_pool_size = 8 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.002597] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] privsep_link.user = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.002755] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.002906] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.003060] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.continue_on_failed_promotions = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.003207] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.dscp = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.003381] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.dscp_inherit = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.003539] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.force_mp_to_policy = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.003682] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.locking_coordinator_url = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.003825] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.log_agent_heartbeats = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.003970] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.logging_expire = 1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.004133] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.004310] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.004428] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.polling_interval = 240 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.004573] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.004721] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.004870] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.report_interval = 30.0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.005035] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.005491] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.005491] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.005491] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.sync_skew = 60 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.005631] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.synchronization_queue_size = 20 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.005750] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT.use_helper_for_ns_read = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.005900] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] SECURITYGROUP.enable_ipset = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.006060] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] SECURITYGROUP.enable_security_group = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.006210] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.006373] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.006519] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] experimental.ipv6_pd_enabled = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.006680] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ml2.extension_drivers = ['port_security'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.006821] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ml2.external_network_type = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.006976] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.007138] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ml2.overlay_ip_version = 4 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.007289] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ml2.path_mtu = 8950 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.007437] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ml2.physical_network_mtus = {} {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.007591] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ml2.tenant_network_types = ['vlan'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.007739] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.007888] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ml2.type_drivers = ['vlan'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.008052] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT_CLI.neutron_port_id = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.008198] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.008341] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.008493] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.008641] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.008788] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.008934] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.009094] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.009243] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.009462] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.009637] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_login_password = **** {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.009789] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_login_port = 443 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.009934] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_login_user = admin {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.010096] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.010252] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.010397] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.010542] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.010688] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.010837] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.010984] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.011143] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.011309] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.011464] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.011613] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.011753] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.011898] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.012108] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.012264] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] vsphere.vsphere_login_password = VMware1! {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.012412] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.012552] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.012697] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.auth_section = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.012854] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.auth_type = password {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.012992] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.013145] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.certfile = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.013286] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.collect_timing = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.013461] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.endpoint_type = public {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.013605] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.insecure = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.013741] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.keyfile = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.013887] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.region_name = RegionOne {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.014038] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.split_loggers = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.014177] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] nova.timeout = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.014322] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.auth_section = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.014470] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.auth_type = password {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.014612] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.014747] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.certfile = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.014884] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.collect_timing = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.015036] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.endpoint_type = public {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.015176] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.insecure = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.015310] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.keyfile = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.015446] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.region_name = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.015578] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.split_loggers = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.015708] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] placement.timeout = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.015851] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.auth_section = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.015988] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.auth_type = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.016132] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.cafile = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.016265] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.certfile = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.016403] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.collect_timing = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.016538] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.connect_retries = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.016671] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.connect_retry_delay = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.016804] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.enable_notifications = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.016940] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.endpoint_override = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.017088] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.insecure = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.017224] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.interface = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.017359] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.keyfile = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.017497] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.max_version = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.017630] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.min_version = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.017763] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.region_name = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.017898] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.retriable_status_codes = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.018041] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.service_name = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.018177] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.service_type = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.018316] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.split_loggers = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.018457] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.status_code_retries = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.018589] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.status_code_retry_delay = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.018721] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.timeout = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.018855] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.valid_interfaces = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.018988] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ironic.version = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.019143] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] cli_script.dry_run = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.019290] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.019466] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.019561] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.019701] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.019853] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.019965] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.020112] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.020254] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.020396] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.020582] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.020760] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.020920] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.021098] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.021257] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.021420] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.021575] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.021721] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.021863] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.022024] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.022171] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.022312] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.022454] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.022596] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.022736] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.022879] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.023025] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.023173] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.023319] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.023479] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.023624] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.023767] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.ssl = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.023915] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.024072] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.024215] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.024367] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.024509] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.ssl_version = {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.024650] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.024805] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_notifications.driver = [] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.024936] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_notifications.retry = -1 {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.025102] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.025243] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] oslo_messaging_notifications.transport_url = **** {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 668.025561] env[69789]: DEBUG oslo_service.backend.eventlet.service [None req-601ada9d-d666-4539-9e9e-f743b2925ccf None None] ******************************************************************************** {{(pid=69789) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 668.026335] env[69789]: DEBUG neutron.agent.securitygroups_rpc [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Init firewall settings (driver=nsxv3) {{(pid=69789) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 668.027622] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69789) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 668.027869] env[69789]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] RPC agent_id: nsxm-l-01a.corp.local [ 668.030181] env[69789]: DEBUG dogpile.cache.region [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.030317] env[69789]: DEBUG dogpile.lock [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.030419] env[69789]: DEBUG dogpile.lock [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.030511] env[69789]: DEBUG dogpile.lock [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.030608] env[69789]: DEBUG dogpile.cache.region [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.030697] env[69789]: DEBUG dogpile.lock [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.030819] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.084243] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Session token - acquiring [ 668.085968] env[69789]: DEBUG networking_nsxv3.common.locking [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.086161] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.086272] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.086750] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.097503] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.384138] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 668.406787] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.407019] env[69789]: DEBUG dogpile.cache.region [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Cache value generated in 0.376 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 668.407095] env[69789]: DEBUG dogpile.lock [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.407203] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Activating Policy API Provider. [ 668.407403] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Looking for the default Infrastructure Rules. [ 668.475550] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Looking for the Default Layer3 Logged Drop Section. [ 668.492208] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 668.493129] env[69789]: DEBUG networking_nsxv3.common.locking [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.493493] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquiring lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.493650] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.494081] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired external semaphore "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.494451] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.012266] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.515392] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.017618] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Inventory metadata is going to be refreshed. [ 670.017973] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 670.856016] env[69789]: DEBUG networking_nsxv3.common.locking [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.856283] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.856390] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.856707] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.867837] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 670.868787] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.869694] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 670.890250] env[69789]: DEBUG networking_nsxv3.common.locking [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.890557] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.890631] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.890877] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.891018] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.891177] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 670.891298] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 670.891441] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 670.912853] env[69789]: DEBUG networking_nsxv3.common.locking [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.913131] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.913257] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.913606] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.913798] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.913947] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 670.936343] env[69789]: DEBUG networking_nsxv3.common.locking [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.936664] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.936664] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.936940] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.937099] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.937245] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 670.956248] env[69789]: DEBUG networking_nsxv3.common.locking [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.956502] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquiring lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.956614] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.956875] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired external semaphore "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.957027] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Releasing lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.957185] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 670.957291] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 670.957400] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 670.976787] env[69789]: DEBUG networking_nsxv3.common.locking [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.977022] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquiring lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.977063] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.977351] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired external semaphore "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.977478] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Releasing lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.977623] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 670.977729] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 670.977844] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 670.998684] env[69789]: DEBUG networking_nsxv3.common.locking [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.998948] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.998948] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.999262] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.999396] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.999550] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 670.999659] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 670.999757] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Inventory metadata have been refreshed. [ 670.999854] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Dryrun:True. Metadata refresh completed. [ 670.999972] env[69789]: DEBUG oslo_concurrency.lockutils [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Releasing lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.001615] env[69789]: INFO neutron.agent.agent_extensions_manager [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Loaded agent extensions: [] [ 671.002329] env[69789]: DEBUG neutron_lib.callbacks.manager [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69789) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 671.060524] env[69789]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] NSXv3 Agent Agent RPC Daemon Started! [ 671.060866] env[69789]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] NSXv3 Agent Agent loop - iteration:0 started [ 671.060866] env[69789]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] NSXv3 Agent Agent out of sync with plugin! [ 676.002678] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 676.003052] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 681.004579] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 681.004579] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 686.005319] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 686.005611] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 686.074692] env[69789]: INFO networking_nsxv3.common.synchronization [None req-b710f5a3-5715-4adf-9bcb-4cb24520de11 demo admin] Enqueued Resource ID: 389ebf4f-1e5f-4f65-8097-d41b6ff6f894 with Priority: HIGHEST for action security_group_rules [ 686.075210] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 389ebf4f-1e5f-4f65-8097-d41b6ff6f894 with Priority: HIGHEST for action security_group_rules [ 686.075525] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-389ebf4f-1e5f-4f65-8097-d41b6ff6f894 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.075655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-389ebf4f-1e5f-4f65-8097-d41b6ff6f894" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.075718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-389ebf4f-1e5f-4f65-8097-d41b6ff6f894" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.076148] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-389ebf4f-1e5f-4f65-8097-d41b6ff6f894" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.076222] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('389ebf4f-1e5f-4f65-8097-d41b6ff6f894',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.598089] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.598307] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.598307] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.598521] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.598615] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.598712] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 389ebf4f-1e5f-4f65-8097-d41b6ff6f894 already deleted. [ 686.598794] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-389ebf4f-1e5f-4f65-8097-d41b6ff6f894" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.076266] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 691.076266] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 695.005822] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.006310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.006310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.006310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.006480] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.508907] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.011774] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.077645] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 696.077879] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 696.514044] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 696.514240] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 697.313037] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.313037] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.313037] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.313037] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.324558] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 697.325424] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.326043] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 697.343235] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.343392] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.343436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.343648] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.343756] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.343874] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 697.343948] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 697.344033] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 697.365399] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.365622] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.365622] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.365809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.365942] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.366076] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 697.384720] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.384916] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.385048] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.385217] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.385322] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.385433] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 697.405367] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.405627] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.405627] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.405748] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.405846] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.405966] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 697.406043] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 697.406124] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 697.423197] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.423371] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.423408] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.423592] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.423714] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.423822] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 697.423885] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 697.423960] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 697.447223] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.447476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.447476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.447620] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.447729] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.447849] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 697.447928] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 697.447992] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 697.448070] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 697.448125] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 697.448189] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 697.448247] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 697.448509] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 697.448570] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 697.448641] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 697.469110] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.469310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.469310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.469504] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.469608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.469718] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 697.490309] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.490506] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.490506] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.490710] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.490813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.502732] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.078680] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 701.079059] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 706.079908] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 706.080382] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 711.081342] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 711.081624] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 714.577570] env[69789]: INFO networking_nsxv3.common.synchronization [None req-841b681b-ec76-4566-85a1-62caac6547ef None None] Enqueued Resource ID: 66bc0290-8ad0-426c-98ad-557202d05bc6 with Priority: HIGHEST for action port [ 714.578587] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66bc0290-8ad0-426c-98ad-557202d05bc6 with Priority: HIGHEST for action port [ 714.578915] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-66bc0290-8ad0-426c-98ad-557202d05bc6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.579278] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66bc0290-8ad0-426c-98ad-557202d05bc6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.579354] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66bc0290-8ad0-426c-98ad-557202d05bc6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.579850] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66bc0290-8ad0-426c-98ad-557202d05bc6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.579941] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66bc0290-8ad0-426c-98ad-557202d05bc6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.083963] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66bc0290-8ad0-426c-98ad-557202d05bc6 [ 715.084236] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.084484] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.084484] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.084641] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.084952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.084952] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66bc0290-8ad0-426c-98ad-557202d05bc6 already deleted. [ 715.084952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66bc0290-8ad0-426c-98ad-557202d05bc6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.792921] env[69789]: INFO networking_nsxv3.common.synchronization [None req-41f0b11d-7b74-4452-859f-dd73876d7625 None None] Enqueued Resource ID: ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8 with Priority: HIGHEST for action port [ 715.793206] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8 with Priority: HIGHEST for action port [ 715.795018] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.795018] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.795018] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.795018] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.795018] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.998734] env[69789]: INFO networking_nsxv3.common.synchronization [None req-996bf7ea-cd65-4886-8982-8596bfc8442f None None] Enqueued Resource ID: dd5b9a4b-c72c-428c-8e01-deaabf72a625 with Priority: HIGHEST for action port [ 715.999260] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5b9a4b-c72c-428c-8e01-deaabf72a625 with Priority: HIGHEST for action port [ 715.999551] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd5b9a4b-c72c-428c-8e01-deaabf72a625 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.999803] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd5b9a4b-c72c-428c-8e01-deaabf72a625" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.999803] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd5b9a4b-c72c-428c-8e01-deaabf72a625" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.000023] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd5b9a4b-c72c-428c-8e01-deaabf72a625" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.000110] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd5b9a4b-c72c-428c-8e01-deaabf72a625',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.297088] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8 [ 716.297786] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.297786] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.297786] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.297786] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.297786] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.297979] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8 already deleted. [ 716.297979] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad79ac85-3927-4b03-bb22-a4ffb2fbd9e8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.506402] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd5b9a4b-c72c-428c-8e01-deaabf72a625 [ 716.507956] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.507956] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.507956] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.508242] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.508421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.508530] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd5b9a4b-c72c-428c-8e01-deaabf72a625 already deleted. [ 716.508618] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd5b9a4b-c72c-428c-8e01-deaabf72a625" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.760404] env[69789]: INFO networking_nsxv3.common.synchronization [None req-67a1f1c6-c30d-47c2-93b9-c4d3b7f9f33e None None] Enqueued Resource ID: 9fd88052-118c-4609-a78a-b69fc93bff37 with Priority: HIGHEST for action port [ 716.760658] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd88052-118c-4609-a78a-b69fc93bff37 with Priority: HIGHEST for action port [ 716.761252] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fd88052-118c-4609-a78a-b69fc93bff37 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.761380] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fd88052-118c-4609-a78a-b69fc93bff37" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.761449] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fd88052-118c-4609-a78a-b69fc93bff37" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.761690] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fd88052-118c-4609-a78a-b69fc93bff37" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.761768] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fd88052-118c-4609-a78a-b69fc93bff37',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.785756] env[69789]: INFO networking_nsxv3.common.synchronization [None req-13e34fdb-8db9-40e0-9a88-fe20f744457f None None] Enqueued Resource ID: 29c49557-3184-43b0-801b-e9f8cc549a04 with Priority: HIGHEST for action port [ 716.786019] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c49557-3184-43b0-801b-e9f8cc549a04 with Priority: HIGHEST for action port [ 716.786830] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-29c49557-3184-43b0-801b-e9f8cc549a04 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.786963] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29c49557-3184-43b0-801b-e9f8cc549a04" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.787040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29c49557-3184-43b0-801b-e9f8cc549a04" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.787280] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29c49557-3184-43b0-801b-e9f8cc549a04" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.787479] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29c49557-3184-43b0-801b-e9f8cc549a04',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.265851] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fd88052-118c-4609-a78a-b69fc93bff37 [ 717.266183] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.266260] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.266305] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.266508] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.266593] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.266688] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fd88052-118c-4609-a78a-b69fc93bff37 already deleted. [ 717.266765] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fd88052-118c-4609-a78a-b69fc93bff37" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.291576] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29c49557-3184-43b0-801b-e9f8cc549a04 [ 717.291576] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.291576] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.291576] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.291576] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.291576] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.291576] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29c49557-3184-43b0-801b-e9f8cc549a04 already deleted. [ 717.291576] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29c49557-3184-43b0-801b-e9f8cc549a04" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.034403] env[69789]: INFO networking_nsxv3.common.synchronization [None req-50f8cf3f-72a4-474e-b0c8-35f1b062f032 None None] Enqueued Resource ID: 635c9ab2-2a7e-4320-89a0-3d9f95df459a with Priority: HIGHEST for action port [ 718.035107] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635c9ab2-2a7e-4320-89a0-3d9f95df459a with Priority: HIGHEST for action port [ 718.038852] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-635c9ab2-2a7e-4320-89a0-3d9f95df459a taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.039062] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-635c9ab2-2a7e-4320-89a0-3d9f95df459a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.039141] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-635c9ab2-2a7e-4320-89a0-3d9f95df459a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.039404] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-635c9ab2-2a7e-4320-89a0-3d9f95df459a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.039491] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('635c9ab2-2a7e-4320-89a0-3d9f95df459a',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.305345] env[69789]: INFO networking_nsxv3.common.synchronization [None req-442e563a-4905-40b9-b01f-4a97a775026d None None] Enqueued Resource ID: 5653faa9-597e-43f3-9b27-e80660f81b76 with Priority: HIGHEST for action port [ 718.305679] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5653faa9-597e-43f3-9b27-e80660f81b76 with Priority: HIGHEST for action port [ 718.306206] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-5653faa9-597e-43f3-9b27-e80660f81b76 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.306500] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5653faa9-597e-43f3-9b27-e80660f81b76" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.306500] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5653faa9-597e-43f3-9b27-e80660f81b76" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.306683] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5653faa9-597e-43f3-9b27-e80660f81b76" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.306771] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5653faa9-597e-43f3-9b27-e80660f81b76',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.541985] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 635c9ab2-2a7e-4320-89a0-3d9f95df459a [ 718.542388] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.542561] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.542636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.542852] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.543117] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.543117] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:635c9ab2-2a7e-4320-89a0-3d9f95df459a already deleted. [ 718.543216] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-635c9ab2-2a7e-4320-89a0-3d9f95df459a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.810497] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5653faa9-597e-43f3-9b27-e80660f81b76 [ 718.812476] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.812476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.812476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.812476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.812476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.812476] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5653faa9-597e-43f3-9b27-e80660f81b76 already deleted. [ 718.812476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5653faa9-597e-43f3-9b27-e80660f81b76" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.881863] env[69789]: INFO networking_nsxv3.common.synchronization [None req-613f85c2-d0f8-4255-b33b-32c14b13839e None None] Enqueued Resource ID: 8ad95ef4-031c-4dcf-8be6-43557731fadd with Priority: HIGHEST for action port [ 718.882175] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ad95ef4-031c-4dcf-8be6-43557731fadd with Priority: HIGHEST for action port [ 718.882902] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ad95ef4-031c-4dcf-8be6-43557731fadd taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.885211] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ad95ef4-031c-4dcf-8be6-43557731fadd" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.885384] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ad95ef4-031c-4dcf-8be6-43557731fadd" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.885642] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ad95ef4-031c-4dcf-8be6-43557731fadd" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.885690] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ad95ef4-031c-4dcf-8be6-43557731fadd',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.387749] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ad95ef4-031c-4dcf-8be6-43557731fadd [ 719.388017] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.388139] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.388207] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.388421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.388513] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.388607] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ad95ef4-031c-4dcf-8be6-43557731fadd already deleted. [ 719.388689] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ad95ef4-031c-4dcf-8be6-43557731fadd" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.663420] env[69789]: INFO networking_nsxv3.common.synchronization [None req-26ad3b13-3e31-4442-afa9-307fa3f2ce22 None None] Enqueued Resource ID: e2a51235-802e-45f7-8474-22a692760164 with Priority: HIGHEST for action port [ 721.663766] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2a51235-802e-45f7-8474-22a692760164 with Priority: HIGHEST for action port [ 721.664734] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2a51235-802e-45f7-8474-22a692760164 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.664734] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2a51235-802e-45f7-8474-22a692760164" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.664734] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2a51235-802e-45f7-8474-22a692760164" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.665400] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2a51235-802e-45f7-8474-22a692760164" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.665400] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2a51235-802e-45f7-8474-22a692760164',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.168298] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2a51235-802e-45f7-8474-22a692760164 [ 722.169444] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.169444] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.169444] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.169444] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.169444] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.169444] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2a51235-802e-45f7-8474-22a692760164 already deleted. [ 722.169444] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2a51235-802e-45f7-8474-22a692760164" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.472504] env[69789]: INFO networking_nsxv3.common.synchronization [None req-27a98bc2-43b4-42f3-994a-c04ed20b23ad None None] Enqueued Resource ID: 0ab9c873-8bf8-455d-bfbe-dafca5c38029 with Priority: HIGHEST for action port [ 722.473277] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab9c873-8bf8-455d-bfbe-dafca5c38029 with Priority: HIGHEST for action port [ 722.473606] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ab9c873-8bf8-455d-bfbe-dafca5c38029 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.473606] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ab9c873-8bf8-455d-bfbe-dafca5c38029" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.473793] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ab9c873-8bf8-455d-bfbe-dafca5c38029" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.474558] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ab9c873-8bf8-455d-bfbe-dafca5c38029" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.474558] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab9c873-8bf8-455d-bfbe-dafca5c38029',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.980717] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ab9c873-8bf8-455d-bfbe-dafca5c38029 [ 722.980717] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.981068] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.981068] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.981210] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.981301] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.981578] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ab9c873-8bf8-455d-bfbe-dafca5c38029 already deleted. [ 722.981578] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ab9c873-8bf8-455d-bfbe-dafca5c38029" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.243681] env[69789]: INFO networking_nsxv3.common.synchronization [None req-75b3921e-5fd8-49c6-8406-a5216fcb1654 None None] Enqueued Resource ID: 0c2df33a-1b25-450b-ac39-f2fca74e10c5 with Priority: HIGHEST for action port [ 723.246019] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2df33a-1b25-450b-ac39-f2fca74e10c5 with Priority: HIGHEST for action port [ 723.246019] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c2df33a-1b25-450b-ac39-f2fca74e10c5 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.246019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c2df33a-1b25-450b-ac39-f2fca74e10c5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.246019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c2df33a-1b25-450b-ac39-f2fca74e10c5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.246019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c2df33a-1b25-450b-ac39-f2fca74e10c5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.246019] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c2df33a-1b25-450b-ac39-f2fca74e10c5',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.748287] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c2df33a-1b25-450b-ac39-f2fca74e10c5 [ 723.749335] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.749614] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.749614] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.749862] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.749902] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.750017] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c2df33a-1b25-450b-ac39-f2fca74e10c5 already deleted. [ 723.750101] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c2df33a-1b25-450b-ac39-f2fca74e10c5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.185661] env[69789]: INFO networking_nsxv3.common.synchronization [None req-d24a97fc-e958-4c44-a019-46335b378563 None None] Enqueued Resource ID: 99d1dbc9-204c-44c2-a22c-5cf78102a234 with Priority: HIGHEST for action port [ 724.186269] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99d1dbc9-204c-44c2-a22c-5cf78102a234 with Priority: HIGHEST for action port [ 724.186609] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-99d1dbc9-204c-44c2-a22c-5cf78102a234 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.186736] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99d1dbc9-204c-44c2-a22c-5cf78102a234" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.186792] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99d1dbc9-204c-44c2-a22c-5cf78102a234" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.187323] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99d1dbc9-204c-44c2-a22c-5cf78102a234" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.187440] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99d1dbc9-204c-44c2-a22c-5cf78102a234',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.406487] env[69789]: INFO networking_nsxv3.common.synchronization [None req-800d90eb-439b-4832-9daa-744a156d3a9e None None] Enqueued Resource ID: 7bbb2630-15cf-4a46-88af-595542a6d718 with Priority: HIGHEST for action port [ 724.406736] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bbb2630-15cf-4a46-88af-595542a6d718 with Priority: HIGHEST for action port [ 724.407332] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bbb2630-15cf-4a46-88af-595542a6d718 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.407458] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bbb2630-15cf-4a46-88af-595542a6d718" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.407535] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bbb2630-15cf-4a46-88af-595542a6d718" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.407775] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bbb2630-15cf-4a46-88af-595542a6d718" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.407854] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bbb2630-15cf-4a46-88af-595542a6d718',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.690312] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99d1dbc9-204c-44c2-a22c-5cf78102a234 [ 724.690528] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.690694] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.690764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.690942] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.691054] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.691209] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99d1dbc9-204c-44c2-a22c-5cf78102a234 already deleted. [ 724.691250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99d1dbc9-204c-44c2-a22c-5cf78102a234" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.911751] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bbb2630-15cf-4a46-88af-595542a6d718 [ 724.911751] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.911751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.911751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.911751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.911751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.911751] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bbb2630-15cf-4a46-88af-595542a6d718 already deleted. [ 724.913864] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bbb2630-15cf-4a46-88af-595542a6d718" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.122136] env[69789]: INFO networking_nsxv3.common.synchronization [None req-49121634-16af-4c1f-bf8f-0f5e01d45328 None None] Enqueued Resource ID: a48fc8f8-0137-417e-aa7a-f83d3e03b7b3 with Priority: HIGHEST for action port [ 725.122410] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a48fc8f8-0137-417e-aa7a-f83d3e03b7b3 with Priority: HIGHEST for action port [ 725.122961] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-a48fc8f8-0137-417e-aa7a-f83d3e03b7b3 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.123102] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a48fc8f8-0137-417e-aa7a-f83d3e03b7b3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.123168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a48fc8f8-0137-417e-aa7a-f83d3e03b7b3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.123424] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a48fc8f8-0137-417e-aa7a-f83d3e03b7b3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.123510] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a48fc8f8-0137-417e-aa7a-f83d3e03b7b3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.571867] env[69789]: INFO networking_nsxv3.common.synchronization [None req-d2dc41e4-8d1a-45f0-af37-9a02b3a0e4a8 None None] Enqueued Resource ID: d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21 with Priority: HIGHEST for action port [ 725.572233] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21 with Priority: HIGHEST for action port [ 725.572769] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.573965] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.573965] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.573965] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.573965] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.629288] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a48fc8f8-0137-417e-aa7a-f83d3e03b7b3 [ 725.630381] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.630381] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.630381] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.630381] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.630381] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.630381] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a48fc8f8-0137-417e-aa7a-f83d3e03b7b3 already deleted. [ 725.630629] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a48fc8f8-0137-417e-aa7a-f83d3e03b7b3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.080461] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21 [ 726.080560] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.080699] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.080766] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.081952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.081952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.081952] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21 already deleted. [ 726.081952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d92a373d-6b7c-4d5e-97f4-cdfb7fbdaa21" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.294336] env[69789]: INFO networking_nsxv3.common.synchronization [req-38f62c80-39e7-48ef-bb12-270671e3e6cc req-3001bd2f-26d7-45dd-a328-4e8ec914b47e tempest-AttachInterfacesV270Test-221984682 tempest-AttachInterfacesV270Test-221984682-project-member] Enqueued Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGHEST for action security_group_members [ 726.294446] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGHEST for action security_group_members [ 726.294780] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f9994a9-d5bc-4285-9c21-cc72e521d44e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.294941] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.295027] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.296318] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.296318] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.296318] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.296318] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.296538] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.296773] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.296773] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.547052] env[69789]: INFO networking_nsxv3.common.synchronization [None req-dabe9a4a-b9ec-4fdd-aef3-8bf717daa87f None None] Enqueued Resource ID: db71f388-858f-41f7-afe3-47b82692d92c with Priority: HIGHEST for action port [ 726.547668] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db71f388-858f-41f7-afe3-47b82692d92c with Priority: HIGHEST for action port [ 726.547865] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-db71f388-858f-41f7-afe3-47b82692d92c taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.547940] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db71f388-858f-41f7-afe3-47b82692d92c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.548017] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db71f388-858f-41f7-afe3-47b82692d92c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.548313] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db71f388-858f-41f7-afe3-47b82692d92c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.548426] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db71f388-858f-41f7-afe3-47b82692d92c',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.803209] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.803209] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.803209] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.803209] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.803209] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.803592] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.803592] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.803592] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.803696] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.803761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.804705] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e already deleted. [ 726.804705] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.859718] env[69789]: INFO networking_nsxv3.common.synchronization [None req-29ed523f-1153-4233-96ef-1825a0529f3e None None] Enqueued Resource ID: 3c871d9b-a5f9-4c75-8888-f29a749e79c0 with Priority: HIGHEST for action port [ 726.860284] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c871d9b-a5f9-4c75-8888-f29a749e79c0 with Priority: HIGHEST for action port [ 726.860634] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c871d9b-a5f9-4c75-8888-f29a749e79c0 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.860764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c871d9b-a5f9-4c75-8888-f29a749e79c0" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.861327] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c871d9b-a5f9-4c75-8888-f29a749e79c0" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.862469] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c871d9b-a5f9-4c75-8888-f29a749e79c0" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.862739] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c871d9b-a5f9-4c75-8888-f29a749e79c0',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.053822] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db71f388-858f-41f7-afe3-47b82692d92c [ 727.054056] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.054199] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.054273] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.054492] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.054597] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.054681] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db71f388-858f-41f7-afe3-47b82692d92c already deleted. [ 727.054761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db71f388-858f-41f7-afe3-47b82692d92c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.367829] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c871d9b-a5f9-4c75-8888-f29a749e79c0 [ 727.367976] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.368135] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.368207] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.368419] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.368986] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.368986] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c871d9b-a5f9-4c75-8888-f29a749e79c0 already deleted. [ 727.368986] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c871d9b-a5f9-4c75-8888-f29a749e79c0" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.923435] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-892 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.925418] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-892" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.925418] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-892" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.925418] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-892" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.925644] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.925816] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.925913] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.926684] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.926887] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.927181] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.927338] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.927485] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.927590] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.927708] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.927826] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.928007] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.933211] env[69789]: INFO networking_nsxv3.common.synchronization [req-2d88e5cd-fee0-405b-9fee-ee9cb72f039e req-28ae3ba6-281e-45ab-b6a3-9804de8f305b tempest-DeleteServersAdminTestJSON-1408950653 tempest-DeleteServersAdminTestJSON-1408950653-project-member] Enqueued Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGHEST for action security_group_members [ 727.934300] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGHEST for action security_group_members [ 727.934914] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.935097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.935249] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.935508] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.935679] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.935785] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.935848] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.936210] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.936560] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.936704] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.953489] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.953489] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 727.953489] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.953585] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-892" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.956569] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-dcea5761-7cad-4443-a674-5ca2c4994581 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.957218] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-dcea5761-7cad-4443-a674-5ca2c4994581" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.957218] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-dcea5761-7cad-4443-a674-5ca2c4994581" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.957390] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-dcea5761-7cad-4443-a674-5ca2c4994581" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.957534] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcea5761-7cad-4443-a674-5ca2c4994581',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.264214] env[69789]: INFO networking_nsxv3.common.synchronization [None req-97458359-8ea7-4c18-840f-8fe2aa7f292d tempest-ServersTestJSON-542552314 tempest-ServersTestJSON-542552314-project-member] Enqueued Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_rules [ 728.264739] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_rules [ 728.265275] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.265275] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.265275] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.266016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.266016] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.357502] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a623dab3-8c9f-4859-99b9-61867aee3dc7 None None] Enqueued Resource ID: 2cc1456a-ac70-403c-92a1-69220b7a4a13 with Priority: HIGHEST for action port [ 728.357790] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc1456a-ac70-403c-92a1-69220b7a4a13 with Priority: HIGHEST for action port [ 728.358941] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cc1456a-ac70-403c-92a1-69220b7a4a13 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.358941] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cc1456a-ac70-403c-92a1-69220b7a4a13" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.358941] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cc1456a-ac70-403c-92a1-69220b7a4a13" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.358941] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cc1456a-ac70-403c-92a1-69220b7a4a13" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.358941] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cc1456a-ac70-403c-92a1-69220b7a4a13',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.438716] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.439272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.439272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.439900] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.439900] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.440038] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.440204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.440204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.440362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.440487] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.440546] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 already deleted. [ 728.440632] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.460282] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.460709] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.460709] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.461012] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.461163] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.461319] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port dcea5761-7cad-4443-a674-5ca2c4994581 not found, creating... [ 728.461590] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.461779] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.461908] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.462197] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.462345] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.462908] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.463429] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.466733] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.466733] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.466733] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.466733] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: dcea5761-7cad-4443-a674-5ca2c4994581 is going to be created. [ 728.469677] env[69789]: INFO networking_nsxv3.common.synchronization [None req-6f97158a-3cad-435f-bc24-4bf454f083eb tempest-ServersTestJSON-542552314 tempest-ServersTestJSON-542552314-project-member] Enqueued Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_rules [ 728.471169] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_rules [ 728.471498] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.471878] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.492768] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.492945] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.493198] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.493459] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.494070] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.494351] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-dcea5761-7cad-4443-a674-5ca2c4994581" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.659922] env[69789]: INFO networking_nsxv3.common.synchronization [None req-e6e42d82-602b-4e3c-b68c-b6df28565b41 None None] Enqueued Resource ID: 2adb699f-220b-4734-aa83-87c9236c9a4d with Priority: HIGHEST for action port [ 728.660164] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2adb699f-220b-4734-aa83-87c9236c9a4d with Priority: HIGHEST for action port [ 728.660701] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-2adb699f-220b-4734-aa83-87c9236c9a4d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.660808] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2adb699f-220b-4734-aa83-87c9236c9a4d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.660881] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2adb699f-220b-4734-aa83-87c9236c9a4d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.663029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2adb699f-220b-4734-aa83-87c9236c9a4d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.663029] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2adb699f-220b-4734-aa83-87c9236c9a4d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.789131] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.789131] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.789131] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.789131] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.789131] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.789131] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e already deleted. [ 728.791039] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.791457] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.792550] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.792916] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.861209] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cc1456a-ac70-403c-92a1-69220b7a4a13 [ 728.861456] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.861592] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.861655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.861867] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.861964] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.862432] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cc1456a-ac70-403c-92a1-69220b7a4a13 already deleted. [ 728.862432] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cc1456a-ac70-403c-92a1-69220b7a4a13" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.054200] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.054200] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.054200] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.054200] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.054200] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.054200] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.054200] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.054680] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.054680] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.054767] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.054869] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.055491] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.055491] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.055491] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.055491] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.055491] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.075130] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.075411] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 729.075482] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.075633] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.076257] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-8a8a7e47-3d72-4d40-b819-2d51cd634de6 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.076257] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-8a8a7e47-3d72-4d40-b819-2d51cd634de6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.076257] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-8a8a7e47-3d72-4d40-b819-2d51cd634de6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.076552] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-8a8a7e47-3d72-4d40-b819-2d51cd634de6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.077666] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a8a7e47-3d72-4d40-b819-2d51cd634de6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.165828] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2adb699f-220b-4734-aa83-87c9236c9a4d [ 729.165828] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.165828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.165828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.165828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.165828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.165828] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2adb699f-220b-4734-aa83-87c9236c9a4d already deleted. [ 729.165828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2adb699f-220b-4734-aa83-87c9236c9a4d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.204268] env[69789]: INFO networking_nsxv3.common.synchronization [req-8b0652cc-18e8-4302-a5cf-b07a361bce75 req-6f47962f-d5fe-4262-aefc-697714561075 tempest-SecurityGroupRulesTestJSON-798938365 tempest-SecurityGroupRulesTestJSON-798938365-project-member] Enqueued Resource ID: eb5b909a-62ec-4cee-ae89-f8e405307a4d with Priority: HIGHEST for action security_group_rules [ 729.204744] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5b909a-62ec-4cee-ae89-f8e405307a4d with Priority: HIGHEST for action security_group_rules [ 729.204744] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb5b909a-62ec-4cee-ae89-f8e405307a4d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.204928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb5b909a-62ec-4cee-ae89-f8e405307a4d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.204995] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb5b909a-62ec-4cee-ae89-f8e405307a4d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.205328] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb5b909a-62ec-4cee-ae89-f8e405307a4d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.205405] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb5b909a-62ec-4cee-ae89-f8e405307a4d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.315148] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.315148] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.315148] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.315148] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.315148] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.315148] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e already deleted. [ 729.315148] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.578974] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.578974] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.579133] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.579354] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.579507] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.579660] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 8a8a7e47-3d72-4d40-b819-2d51cd634de6 not found, creating... [ 729.579921] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.580100] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.580216] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.580428] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.580561] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.580833] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.580980] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.581107] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.581307] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.581452] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.581620] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 8a8a7e47-3d72-4d40-b819-2d51cd634de6 is going to be created. [ 729.607571] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.608126] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.608348] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.609956] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.609956] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.609956] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-8a8a7e47-3d72-4d40-b819-2d51cd634de6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.737272] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.737272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.737272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.737272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.737272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.737272] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb5b909a-62ec-4cee-ae89-f8e405307a4d already deleted. [ 729.737272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb5b909a-62ec-4cee-ae89-f8e405307a4d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.203288] env[69789]: INFO networking_nsxv3.common.synchronization [req-38f62c80-39e7-48ef-bb12-270671e3e6cc req-60bc764d-c722-4efa-98ef-6953d2f08991 service nova] Enqueued Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGHEST for action security_group_rules [ 730.203892] env[69789]: INFO networking_nsxv3.common.synchronization [req-38f62c80-39e7-48ef-bb12-270671e3e6cc req-60bc764d-c722-4efa-98ef-6953d2f08991 service nova] Enqueued Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGHEST for action security_group_members [ 730.203892] env[69789]: INFO networking_nsxv3.common.synchronization [req-38f62c80-39e7-48ef-bb12-270671e3e6cc req-60bc764d-c722-4efa-98ef-6953d2f08991 service nova] Enqueued Resource ID: dcea5761-7cad-4443-a674-5ca2c4994581 with Priority: HIGHEST for action port [ 730.203892] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGHEST for action security_group_rules [ 730.203988] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGHEST for action security_group_members [ 730.204049] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcea5761-7cad-4443-a674-5ca2c4994581 with Priority: HIGHEST for action port [ 730.206710] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.207089] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.207089] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.208158] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.208158] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.209871] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f9994a9-d5bc-4285-9c21-cc72e521d44e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.209871] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.209871] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.209871] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.209871] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.209871] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.209871] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.209871] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.209871] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.209871] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.213144] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcea5761-7cad-4443-a674-5ca2c4994581 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.213259] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcea5761-7cad-4443-a674-5ca2c4994581" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.213534] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcea5761-7cad-4443-a674-5ca2c4994581" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.213609] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcea5761-7cad-4443-a674-5ca2c4994581" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.213675] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcea5761-7cad-4443-a674-5ca2c4994581',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.709626] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f9994a9-d5bc-4285-9c21-cc72e521d44e taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.709765] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.714220] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.715447] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcea5761-7cad-4443-a674-5ca2c4994581 with status ACTIVE [ 730.715566] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.715691] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.715758] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.716009] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.716116] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.716309] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.716460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.716460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.716627] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.716701] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.716887] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.716980] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.717053] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.720102] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.720102] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.720102] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcea5761-7cad-4443-a674-5ca2c4994581 is going to be updated. [ 730.741557] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.741557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.741557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.741557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.741557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.741557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcea5761-7cad-4443-a674-5ca2c4994581" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.028800] env[69789]: INFO networking_nsxv3.common.synchronization [req-2d88e5cd-fee0-405b-9fee-ee9cb72f039e req-14c7f749-cc7b-452b-8dea-d110cf800d50 service nova] Enqueued Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGHEST for action security_group_rules [ 731.029083] env[69789]: INFO networking_nsxv3.common.synchronization [req-2d88e5cd-fee0-405b-9fee-ee9cb72f039e req-14c7f749-cc7b-452b-8dea-d110cf800d50 service nova] Enqueued Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGHEST for action security_group_members [ 731.029199] env[69789]: INFO networking_nsxv3.common.synchronization [req-2d88e5cd-fee0-405b-9fee-ee9cb72f039e req-14c7f749-cc7b-452b-8dea-d110cf800d50 service nova] Enqueued Resource ID: 8a8a7e47-3d72-4d40-b819-2d51cd634de6 with Priority: HIGHEST for action port [ 731.030388] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGHEST for action security_group_rules [ 731.030388] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGHEST for action security_group_members [ 731.030388] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a8a7e47-3d72-4d40-b819-2d51cd634de6 with Priority: HIGHEST for action port [ 731.030388] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.031020] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.031020] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.031020] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.031020] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.034543] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.034636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.034698] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.034930] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.035190] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.035190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.035264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.035382] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.035476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.035569] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.037802] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a8a7e47-3d72-4d40-b819-2d51cd634de6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.037937] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a8a7e47-3d72-4d40-b819-2d51cd634de6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.038024] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a8a7e47-3d72-4d40-b819-2d51cd634de6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.038269] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a8a7e47-3d72-4d40-b819-2d51cd634de6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.038351] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a8a7e47-3d72-4d40-b819-2d51cd634de6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.221025] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.395144] env[69789]: INFO networking_nsxv3.common.synchronization [None req-7656d2b3-84fd-4035-b84d-3da3f300bede None None] Enqueued Resource ID: c1d9f9bb-82bd-4b27-97db-5771c36c740c with Priority: HIGHEST for action port [ 731.395410] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d9f9bb-82bd-4b27-97db-5771c36c740c with Priority: HIGHEST for action port [ 731.396255] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1d9f9bb-82bd-4b27-97db-5771c36c740c taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.396390] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1d9f9bb-82bd-4b27-97db-5771c36c740c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.397207] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1d9f9bb-82bd-4b27-97db-5771c36c740c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.397207] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1d9f9bb-82bd-4b27-97db-5771c36c740c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.397207] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1d9f9bb-82bd-4b27-97db-5771c36c740c',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.541667] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.541667] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.548396] env[69789]: INFO networking_nsxv3.common.synchronization [req-9ac6912d-b9ea-46ee-8315-7e4c063fa61d req-8155b5d5-5b2d-4a92-a642-0a11242b25b2 tempest-SecurityGroupRulesTestJSON-798938365 tempest-SecurityGroupRulesTestJSON-798938365-project-member] Enqueued Resource ID: 22c3fd1a-6e9a-4cf7-903b-f0f230a5c840 with Priority: HIGHEST for action security_group_rules [ 731.549103] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22c3fd1a-6e9a-4cf7-903b-f0f230a5c840 with Priority: HIGHEST for action security_group_rules [ 731.549504] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22c3fd1a-6e9a-4cf7-903b-f0f230a5c840 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.549565] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22c3fd1a-6e9a-4cf7-903b-f0f230a5c840" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.549608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22c3fd1a-6e9a-4cf7-903b-f0f230a5c840" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.549928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22c3fd1a-6e9a-4cf7-903b-f0f230a5c840" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.549928] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22c3fd1a-6e9a-4cf7-903b-f0f230a5c840',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.560540] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a8a7e47-3d72-4d40-b819-2d51cd634de6 with status ACTIVE [ 731.566132] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.566132] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.566132] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.566132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.566132] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a8a7e47-3d72-4d40-b819-2d51cd634de6 is going to be updated. [ 731.568989] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.608718] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.608718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.608718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.608718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.608718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.608718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a8a7e47-3d72-4d40-b819-2d51cd634de6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.723826] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.723993] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.724088] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.724317] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.724407] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.724510] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e is going to be created. [ 731.753037] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.753255] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.753355] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.755167] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.755452] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.771854] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e in Status: UNINITIALIZED for 2s [ 731.900590] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1d9f9bb-82bd-4b27-97db-5771c36c740c [ 731.900590] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.900590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.900590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.900590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.900590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.900590] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1d9f9bb-82bd-4b27-97db-5771c36c740c already deleted. [ 731.900590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1d9f9bb-82bd-4b27-97db-5771c36c740c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.074044] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.079000] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.079236] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.079236] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.079670] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.079670] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.079670] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22c3fd1a-6e9a-4cf7-903b-f0f230a5c840 already deleted. [ 732.079670] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22c3fd1a-6e9a-4cf7-903b-f0f230a5c840" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.143422] env[69789]: INFO networking_nsxv3.common.synchronization [None req-72003740-73e1-4e78-a7de-d5c4cc05a254 None None] Enqueued Resource ID: 420054ba-4190-49c0-a973-42341ad7d37b with Priority: HIGHEST for action port [ 732.143422] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420054ba-4190-49c0-a973-42341ad7d37b with Priority: HIGHEST for action port [ 732.143422] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-420054ba-4190-49c0-a973-42341ad7d37b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.143422] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-420054ba-4190-49c0-a973-42341ad7d37b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.143422] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-420054ba-4190-49c0-a973-42341ad7d37b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.145518] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-420054ba-4190-49c0-a973-42341ad7d37b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.145518] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('420054ba-4190-49c0-a973-42341ad7d37b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.579383] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.579734] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.580325] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.580670] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.580782] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.580895] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 is going to be created. [ 732.610261] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.610560] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.610687] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.610872] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.611529] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.623900] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 in Status: UNINITIALIZED for 2s [ 732.651158] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 420054ba-4190-49c0-a973-42341ad7d37b [ 732.651158] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.651158] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.651158] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.651413] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.651455] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.651694] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:420054ba-4190-49c0-a973-42341ad7d37b already deleted. [ 732.651694] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-420054ba-4190-49c0-a973-42341ad7d37b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.205500] env[69789]: INFO networking_nsxv3.common.synchronization [req-f7c00868-64e6-49ce-8075-5e9dc78cd478 req-efa8c834-39a7-42e9-aa04-8b9399966eb0 tempest-ServerExternalEventsTest-763372503 tempest-ServerExternalEventsTest-763372503-project-member] Enqueued Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGHEST for action security_group_members [ 733.209402] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGHEST for action security_group_members [ 733.209402] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.209402] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.209402] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.209402] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.209402] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.209402] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.209402] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.209788] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.209788] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.209788] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.713649] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.713649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.713649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.713649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.713649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.714421] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.714421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.714421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.716292] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.716449] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.716587] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 already deleted. [ 733.716736] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.785040] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e in Status: SUCCESS [ 733.785420] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.785609] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.785923] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.786206] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.786379] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.786463] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.786706] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.788839] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.789106] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.789843] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.296045] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f9994a9-d5bc-4285-9c21-cc72e521d44e taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.296202] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.296317] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.296748] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.296748] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.296859] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.296932] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.297125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.297212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.297302] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.297469] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f9994a9-d5bc-4285-9c21-cc72e521d44e taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.297566] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.297716] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.297793] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.298047] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.298047] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.298154] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.298236] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.298355] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.298501] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.298631] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.634963] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 in Status: SUCCESS [ 734.635392] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.635392] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.636030] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.636030] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.636185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.636249] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.636491] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.636616] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.636719] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.636815] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.691301] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.691498] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.691620] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.691897] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.692168] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.692320] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.692431] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.692720] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.693480] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.693894] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.694019] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.694809] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.694809] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.694809] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.694809] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.694809] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.701693] env[69789]: INFO networking_nsxv3.common.synchronization [None req-d15dbf74-ad49-4efd-bda6-f1594637bf1c None None] Enqueued Resource ID: 62d4ae2d-3de6-4903-9ea6-d49a64779a7a with Priority: HIGHEST for action port [ 734.702353] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62d4ae2d-3de6-4903-9ea6-d49a64779a7a with Priority: HIGHEST for action port [ 734.702543] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-62d4ae2d-3de6-4903-9ea6-d49a64779a7a taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.702543] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62d4ae2d-3de6-4903-9ea6-d49a64779a7a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.702641] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62d4ae2d-3de6-4903-9ea6-d49a64779a7a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.702875] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62d4ae2d-3de6-4903-9ea6-d49a64779a7a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.703218] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62d4ae2d-3de6-4903-9ea6-d49a64779a7a',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.714282] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.714282] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 734.714282] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.714282] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.715062] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-6196c31c-6907-4695-91cf-2de0c3cac58f taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.715528] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-6196c31c-6907-4695-91cf-2de0c3cac58f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.715528] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-6196c31c-6907-4695-91cf-2de0c3cac58f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.715622] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-6196c31c-6907-4695-91cf-2de0c3cac58f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.716431] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6196c31c-6907-4695-91cf-2de0c3cac58f',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.802842] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f9994a9-d5bc-4285-9c21-cc72e521d44e: rpc.has_security_group_logging(os_id): False [ 734.823243] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.823639] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.824321] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.824626] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.825644] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.825644] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.825644] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.825644] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.825644] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.826323] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.826323] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.826721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.827041] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.827549] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.827549] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.827872] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.828150] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.828419] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.828834] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.829090] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.829182] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e is going to be created. [ 734.898902] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.898902] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.899019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.899830] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.900341] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.916030] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e in Status: IN_PROGRESS for 2s [ 735.141702] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.141839] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.141924] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.142289] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.142382] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.142493] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.142561] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.142858] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.142952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.143056] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.145204] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.145204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.145204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.145204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.145204] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.145204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.145204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.145204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.145204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.145204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.145204] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.206482] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62d4ae2d-3de6-4903-9ea6-d49a64779a7a [ 735.206631] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.206833] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.206900] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.207813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.207813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.207813] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62d4ae2d-3de6-4903-9ea6-d49a64779a7a already deleted. [ 735.207813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62d4ae2d-3de6-4903-9ea6-d49a64779a7a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.220714] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.220959] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.221055] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.221347] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.221505] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.221638] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 6196c31c-6907-4695-91cf-2de0c3cac58f not found, creating... [ 735.221894] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.222056] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.222167] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.222379] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.223429] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.223429] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.223429] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.223429] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.223429] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.223429] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.223665] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 6196c31c-6907-4695-91cf-2de0c3cac58f is going to be created. [ 735.247287] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.247503] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.247628] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.247894] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.248141] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.248372] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-6196c31c-6907-4695-91cf-2de0c3cac58f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.437740] env[69789]: INFO networking_nsxv3.common.synchronization [None req-dade300a-1fe3-4848-87eb-59f024cc1c0a None None] Enqueued Resource ID: c5715891-8ff5-47a4-86cc-1ad4833ad11f with Priority: HIGHEST for action port [ 735.438046] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5715891-8ff5-47a4-86cc-1ad4833ad11f with Priority: HIGHEST for action port [ 735.438831] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5715891-8ff5-47a4-86cc-1ad4833ad11f taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.438831] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5715891-8ff5-47a4-86cc-1ad4833ad11f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.438831] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5715891-8ff5-47a4-86cc-1ad4833ad11f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.439858] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5715891-8ff5-47a4-86cc-1ad4833ad11f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.439943] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5715891-8ff5-47a4-86cc-1ad4833ad11f',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.582825] env[69789]: INFO networking_nsxv3.common.synchronization [None req-6cc30aaa-3e09-4fee-ab87-c7450f9d5235 tempest-VolumesAssistedSnapshotsTest-805540586 tempest-VolumesAssistedSnapshotsTest-805540586-project-member] Enqueued Resource ID: c780ac16-31de-4808-be87-d81d27e4bb61 with Priority: HIGHEST for action security_group_rules [ 735.583388] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c780ac16-31de-4808-be87-d81d27e4bb61 with Priority: HIGHEST for action security_group_rules [ 735.583692] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c780ac16-31de-4808-be87-d81d27e4bb61 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.583821] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c780ac16-31de-4808-be87-d81d27e4bb61" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.583890] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c780ac16-31de-4808-be87-d81d27e4bb61" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.585726] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c780ac16-31de-4808-be87-d81d27e4bb61" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.585823] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c780ac16-31de-4808-be87-d81d27e4bb61',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.651109] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9ef20af-ee9f-4f45-8eda-e9a89c8415d4: rpc.has_security_group_logging(os_id): False [ 735.671528] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.671680] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.671774] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.671992] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.672097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.672297] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.672392] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.672451] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.672611] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.672663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.672827] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.673031] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.673031] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.673134] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.673919] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.673919] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.673919] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.673919] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.673919] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.673919] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.673919] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 is going to be created. [ 735.742647] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.742914] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.742914] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.744576] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.744576] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.755171] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 in Status: IN_PROGRESS for 2s [ 735.945009] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5715891-8ff5-47a4-86cc-1ad4833ad11f [ 735.945009] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.945167] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.945233] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.945516] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.945635] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.945699] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5715891-8ff5-47a4-86cc-1ad4833ad11f already deleted. [ 735.945740] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5715891-8ff5-47a4-86cc-1ad4833ad11f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.107147] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.107147] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.107147] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.107147] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.107147] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.107147] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c780ac16-31de-4808-be87-d81d27e4bb61 already deleted. [ 736.107147] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c780ac16-31de-4808-be87-d81d27e4bb61" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.143634] env[69789]: INFO networking_nsxv3.common.synchronization [None req-0188fc38-4b0b-41e3-8cba-1adbac082391 None None] Enqueued Resource ID: 520569a0-6307-4dfd-983f-29093ef2601c with Priority: HIGHEST for action port [ 736.143634] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520569a0-6307-4dfd-983f-29093ef2601c with Priority: HIGHEST for action port [ 736.143634] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-520569a0-6307-4dfd-983f-29093ef2601c taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.143634] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-520569a0-6307-4dfd-983f-29093ef2601c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.143634] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-520569a0-6307-4dfd-983f-29093ef2601c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.143634] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-520569a0-6307-4dfd-983f-29093ef2601c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.144706] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('520569a0-6307-4dfd-983f-29093ef2601c',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.191329] env[69789]: INFO networking_nsxv3.common.synchronization [None req-dfefd6bb-2bb0-4455-97b0-5ddb99a05598 tempest-VolumesAssistedSnapshotsTest-805540586 tempest-VolumesAssistedSnapshotsTest-805540586-project-member] Enqueued Resource ID: c780ac16-31de-4808-be87-d81d27e4bb61 with Priority: HIGHEST for action security_group_rules [ 736.191329] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c780ac16-31de-4808-be87-d81d27e4bb61 with Priority: HIGHEST for action security_group_rules [ 736.191329] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c780ac16-31de-4808-be87-d81d27e4bb61 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.191329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c780ac16-31de-4808-be87-d81d27e4bb61" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.191329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c780ac16-31de-4808-be87-d81d27e4bb61" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.191329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c780ac16-31de-4808-be87-d81d27e4bb61" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.191329] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c780ac16-31de-4808-be87-d81d27e4bb61',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.397515] env[69789]: INFO networking_nsxv3.common.synchronization [None req-34b91bc0-84ef-48f2-9985-d5e79f02d6b3 None None] Enqueued Resource ID: 991927ae-ba88-4de9-acf6-27b4b1ae42a8 with Priority: HIGHEST for action port [ 736.398195] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 991927ae-ba88-4de9-acf6-27b4b1ae42a8 with Priority: HIGHEST for action port [ 736.398716] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-991927ae-ba88-4de9-acf6-27b4b1ae42a8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.398849] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-991927ae-ba88-4de9-acf6-27b4b1ae42a8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.398938] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-991927ae-ba88-4de9-acf6-27b4b1ae42a8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.399188] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-991927ae-ba88-4de9-acf6-27b4b1ae42a8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.399269] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('991927ae-ba88-4de9-acf6-27b4b1ae42a8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.650335] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 520569a0-6307-4dfd-983f-29093ef2601c [ 736.650966] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.651709] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.651856] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.652063] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.652298] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.652298] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:520569a0-6307-4dfd-983f-29093ef2601c already deleted. [ 736.652483] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-520569a0-6307-4dfd-983f-29093ef2601c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.724737] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.724737] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.724737] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.725759] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.725759] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.725759] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c780ac16-31de-4808-be87-d81d27e4bb61 already deleted. [ 736.725759] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c780ac16-31de-4808-be87-d81d27e4bb61" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.905290] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 991927ae-ba88-4de9-acf6-27b4b1ae42a8 [ 736.905290] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.905290] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.905290] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.905290] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.905290] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.905893] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:991927ae-ba88-4de9-acf6-27b4b1ae42a8 already deleted. [ 736.905893] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-991927ae-ba88-4de9-acf6-27b4b1ae42a8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.939105] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e in Status: SUCCESS [ 736.939105] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.774970] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 in Status: SUCCESS [ 737.774970] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.992365] env[69789]: INFO networking_nsxv3.common.synchronization [req-f7c00868-64e6-49ce-8075-5e9dc78cd478 req-bb57ba1d-b95c-4f7c-9725-7a43e175f5a9 service nova] Enqueued Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGHEST for action security_group_rules [ 737.992739] env[69789]: INFO networking_nsxv3.common.synchronization [req-f7c00868-64e6-49ce-8075-5e9dc78cd478 req-bb57ba1d-b95c-4f7c-9725-7a43e175f5a9 service nova] Enqueued Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGHEST for action security_group_members [ 737.992739] env[69789]: INFO networking_nsxv3.common.synchronization [req-f7c00868-64e6-49ce-8075-5e9dc78cd478 req-bb57ba1d-b95c-4f7c-9725-7a43e175f5a9 service nova] Enqueued Resource ID: 6196c31c-6907-4695-91cf-2de0c3cac58f with Priority: HIGHEST for action port [ 737.992888] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGHEST for action security_group_rules [ 737.992998] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGHEST for action security_group_members [ 737.993109] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6196c31c-6907-4695-91cf-2de0c3cac58f with Priority: HIGHEST for action port [ 737.993680] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.993809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.993874] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.995415] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.996912] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.998086] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.998211] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.998278] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.999016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.999016] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.999016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.999016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.999016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.999016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.999297] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.001519] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-6196c31c-6907-4695-91cf-2de0c3cac58f taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.001643] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6196c31c-6907-4695-91cf-2de0c3cac58f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.001692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6196c31c-6907-4695-91cf-2de0c3cac58f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.001861] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6196c31c-6907-4695-91cf-2de0c3cac58f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.001935] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6196c31c-6907-4695-91cf-2de0c3cac58f',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.386805] env[69789]: INFO networking_nsxv3.common.synchronization [None req-66499c9d-3dd3-4b4e-be8d-9b2b7a9418fb None None] Enqueued Resource ID: d0bd6599-1ec7-427d-b58e-fa5d9497aaa0 with Priority: HIGHEST for action port [ 738.387444] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0bd6599-1ec7-427d-b58e-fa5d9497aaa0 with Priority: HIGHEST for action port [ 738.389061] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0bd6599-1ec7-427d-b58e-fa5d9497aaa0 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.389164] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0bd6599-1ec7-427d-b58e-fa5d9497aaa0" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.389323] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0bd6599-1ec7-427d-b58e-fa5d9497aaa0" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.390136] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0bd6599-1ec7-427d-b58e-fa5d9497aaa0" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.390136] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0bd6599-1ec7-427d-b58e-fa5d9497aaa0',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.443952] env[69789]: INFO networking_nsxv3.common.synchronization [req-8a133c3d-8ea6-4300-bb38-a3b1a96e7d4a req-1d178158-29cf-428a-9d4b-7c50ba805bbc tempest-SecurityGroupRulesTestJSON-798938365 tempest-SecurityGroupRulesTestJSON-798938365-project-member] Enqueued Resource ID: d7949585-ac1e-4d2d-9969-a15fe1f8ae11 with Priority: HIGHEST for action security_group_rules [ 738.443952] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7949585-ac1e-4d2d-9969-a15fe1f8ae11 with Priority: HIGHEST for action security_group_rules [ 738.443952] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7949585-ac1e-4d2d-9969-a15fe1f8ae11 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.443952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7949585-ac1e-4d2d-9969-a15fe1f8ae11" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.443952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7949585-ac1e-4d2d-9969-a15fe1f8ae11" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.443952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7949585-ac1e-4d2d-9969-a15fe1f8ae11" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.443952] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7949585-ac1e-4d2d-9969-a15fe1f8ae11',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.505190] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.505804] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.505804] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.505990] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6196c31c-6907-4695-91cf-2de0c3cac58f with status ACTIVE [ 738.506340] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.507021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.507111] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.507401] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.507938] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.509752] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.509881] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.509948] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.510197] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.510258] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.510467] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.510579] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.510625] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.510782] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.510860] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.510985] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6196c31c-6907-4695-91cf-2de0c3cac58f is going to be updated. [ 738.540050] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.540050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.540050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.540050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.540050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.541636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6196c31c-6907-4695-91cf-2de0c3cac58f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.863051] env[69789]: INFO networking_nsxv3.common.synchronization [None req-e60f7298-2a40-42d2-bfb7-8b96b250d97c tempest-VolumesAdminNegativeTest-161696083 tempest-VolumesAdminNegativeTest-161696083-project-member] Enqueued Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_rules [ 738.866425] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_rules [ 738.866425] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-367b3953-c384-4a92-8d77-5aeea593412d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.867202] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.867484] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.867902] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.868099] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.894045] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0bd6599-1ec7-427d-b58e-fa5d9497aaa0 [ 738.894045] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.894045] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.894045] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.894045] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.894045] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.894045] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0bd6599-1ec7-427d-b58e-fa5d9497aaa0 already deleted. [ 738.894045] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0bd6599-1ec7-427d-b58e-fa5d9497aaa0" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.970202] env[69789]: INFO networking_nsxv3.common.synchronization [None req-839e3969-c05a-4fce-8973-24808a43c0ba None None] Enqueued Resource ID: e2b94010-a084-4f74-b551-c44870a9672a with Priority: HIGHEST for action port [ 738.972380] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.972828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.972828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.972933] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.974337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.974337] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7949585-ac1e-4d2d-9969-a15fe1f8ae11 already deleted. [ 738.974337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7949585-ac1e-4d2d-9969-a15fe1f8ae11" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.974337] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2b94010-a084-4f74-b551-c44870a9672a with Priority: HIGHEST for action port [ 738.974596] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2b94010-a084-4f74-b551-c44870a9672a taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.974758] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2b94010-a084-4f74-b551-c44870a9672a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.975915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2b94010-a084-4f74-b551-c44870a9672a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.976557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2b94010-a084-4f74-b551-c44870a9672a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.976663] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b94010-a084-4f74-b551-c44870a9672a',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.015894] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.398502] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.398502] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.398502] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.398502] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.398502] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.398502] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 367b3953-c384-4a92-8d77-5aeea593412d already deleted. [ 739.398502] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.482024] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2b94010-a084-4f74-b551-c44870a9672a [ 739.482024] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.482024] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.482024] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.482024] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.482347] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.482347] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2b94010-a084-4f74-b551-c44870a9672a already deleted. [ 739.482801] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2b94010-a084-4f74-b551-c44870a9672a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.520297] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.520415] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.520468] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.520684] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.520788] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.520859] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 is going to be created. [ 739.546659] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.546659] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.546659] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.546907] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.547097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.559045] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 in Status: UNINITIALIZED for 2s [ 739.605597] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a537212e-2d7d-4ab1-8411-d3dbf5ebe744 tempest-ServersWithSpecificFlavorTestJSON-738434098 tempest-ServersWithSpecificFlavorTestJSON-738434098-project-member] Enqueued Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_rules [ 739.606294] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_rules [ 739.606659] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.606817] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.606876] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.607527] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.607527] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.914786] env[69789]: INFO networking_nsxv3.common.synchronization [None req-983a9963-6bd5-48a9-934e-3766e75c3b7a tempest-VolumesAdminNegativeTest-161696083 tempest-VolumesAdminNegativeTest-161696083-project-member] Enqueued Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_rules [ 739.914786] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_rules [ 739.915702] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-367b3953-c384-4a92-8d77-5aeea593412d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.915944] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.916480] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.916993] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.917423] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.936297] env[69789]: INFO networking_nsxv3.common.synchronization [req-4bef1b05-a9b6-4419-9629-4c2bba7b2c1a req-00a8b470-34cb-4cca-979b-63009b49adc6 tempest-ServersTestJSON-542552314 tempest-ServersTestJSON-542552314-project-member] Enqueued Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_members [ 739.936863] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_members [ 739.937164] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.937365] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.937365] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.937616] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.937808] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.937942] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.938054] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.938393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.938602] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.938754] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.132238] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.133842] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.133842] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.134226] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.134547] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.134547] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 already deleted. [ 740.134547] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.442538] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.442791] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.442791] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.443247] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.443247] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.443433] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.443567] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.443652] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.444213] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.444336] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.444434] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e already deleted. [ 740.444542] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.446472] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.446621] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.446692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.446918] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.447287] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.447435] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 367b3953-c384-4a92-8d77-5aeea593412d already deleted. [ 740.447564] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.510435] env[69789]: INFO networking_nsxv3.common.synchronization [None req-9ec343d9-7e2b-44f8-a326-51a20333444e tempest-ServersWithSpecificFlavorTestJSON-738434098 tempest-ServersWithSpecificFlavorTestJSON-738434098-project-member] Enqueued Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_rules [ 740.514634] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_rules [ 740.514980] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.515191] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.515191] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.515488] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.515488] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.718350] env[69789]: INFO networking_nsxv3.common.synchronization [None req-ff4b79db-ecd6-440c-98e6-1751983beaf4 None None] Enqueued Resource ID: de552d56-3431-4bc4-825d-0451db89336d with Priority: HIGHEST for action port [ 740.718589] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de552d56-3431-4bc4-825d-0451db89336d with Priority: HIGHEST for action port [ 740.721199] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-de552d56-3431-4bc4-825d-0451db89336d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.721199] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de552d56-3431-4bc4-825d-0451db89336d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.721199] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de552d56-3431-4bc4-825d-0451db89336d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.721979] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de552d56-3431-4bc4-825d-0451db89336d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.721979] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de552d56-3431-4bc4-825d-0451db89336d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.802891] env[69789]: INFO networking_nsxv3.common.synchronization [None req-b11c8f2b-94e9-472f-95ff-fe9dbbba0983 None None] Enqueued Resource ID: 182f2dbc-4077-4215-bbec-f25a65029b12 with Priority: HIGHEST for action port [ 740.803176] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 182f2dbc-4077-4215-bbec-f25a65029b12 with Priority: HIGHEST for action port [ 740.804021] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-182f2dbc-4077-4215-bbec-f25a65029b12 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.804145] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-182f2dbc-4077-4215-bbec-f25a65029b12" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.804445] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-182f2dbc-4077-4215-bbec-f25a65029b12" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.804636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-182f2dbc-4077-4215-bbec-f25a65029b12" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.804716] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('182f2dbc-4077-4215-bbec-f25a65029b12',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.043692] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.043692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.043692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.043953] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.044193] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.044193] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 already deleted. [ 741.044565] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.115355] env[69789]: INFO networking_nsxv3.common.synchronization [req-e664f57d-0a2e-4fe6-9820-35a812e71814 req-b8751ef0-28e0-475e-84d6-321c637fe66a tempest-ServersAdminNegativeTestJSON-280202454 tempest-ServersAdminNegativeTestJSON-280202454-project-member] Enqueued Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGHEST for action security_group_members [ 741.116747] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGHEST for action security_group_members [ 741.117360] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b546181-293b-47af-ad81-70b5a00fd2e3 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.117722] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.117722] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.117957] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.118135] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.118246] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.118316] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.118462] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.118539] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.118640] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.227029] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de552d56-3431-4bc4-825d-0451db89336d [ 741.227277] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.227511] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.227572] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.228397] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.228397] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.228397] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de552d56-3431-4bc4-825d-0451db89336d already deleted. [ 741.228397] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de552d56-3431-4bc4-825d-0451db89336d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.308277] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 182f2dbc-4077-4215-bbec-f25a65029b12 [ 741.309420] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.309420] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.309420] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.309420] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.309420] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.309420] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:182f2dbc-4077-4215-bbec-f25a65029b12 already deleted. [ 741.309420] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-182f2dbc-4077-4215-bbec-f25a65029b12" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.573655] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 in Status: SUCCESS [ 741.573655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.573655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.573655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.573655] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.576862] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.577264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.578514] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.578653] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.579026] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.579172] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.621716] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.621829] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.621907] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.622135] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.622230] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.622432] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.622530] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.622599] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.622753] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.622832] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.622915] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 already deleted. [ 741.622994] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.009899] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.010037] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.010227] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.010417] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.010664] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.010807] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.011162] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.017179] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.017179] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.017179] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.017179] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.017179] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.017179] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.017179] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.017179] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.017179] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.020479] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.020658] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-418" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.020775] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-418" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.021143] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-418" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.021409] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.021572] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.021713] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.021938] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.022114] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.022330] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.025021] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.025021] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.025021] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.025021] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.025021] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.025021] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.046629] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.047396] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.047396] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.047396] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.047903] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-327722fe-c5c2-466f-92ca-c218e5304f72 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.048208] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-327722fe-c5c2-466f-92ca-c218e5304f72" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.048371] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-327722fe-c5c2-466f-92ca-c218e5304f72" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.048747] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-327722fe-c5c2-466f-92ca-c218e5304f72" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.049442] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('327722fe-c5c2-466f-92ca-c218e5304f72',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.054857] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.056376] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.056652] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.060231] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-418" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.060231] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-65b8c00f-8a84-4930-a8b4-c7a8e994421b taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.060231] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-65b8c00f-8a84-4930-a8b4-c7a8e994421b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.060231] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-65b8c00f-8a84-4930-a8b4-c7a8e994421b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.060231] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-65b8c00f-8a84-4930-a8b4-c7a8e994421b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.060231] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65b8c00f-8a84-4930-a8b4-c7a8e994421b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.082679] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.082679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.082679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.082679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.082679] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.082679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.082679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.082679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.082978] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.083143] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.083231] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.083337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.083405] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.083554] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.083691] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.083779] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.083926] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.083972] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.084343] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.084343] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.084343] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.445175] env[69789]: INFO networking_nsxv3.common.synchronization [None req-e60c3a2b-2c74-452f-9c09-aad38214f633 None None] Enqueued Resource ID: ad1f2977-cba5-4020-94f0-0a1f7ec91173 with Priority: HIGHEST for action port [ 742.446761] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad1f2977-cba5-4020-94f0-0a1f7ec91173 with Priority: HIGHEST for action port [ 742.446761] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad1f2977-cba5-4020-94f0-0a1f7ec91173 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.446900] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad1f2977-cba5-4020-94f0-0a1f7ec91173" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.446944] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad1f2977-cba5-4020-94f0-0a1f7ec91173" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.447978] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad1f2977-cba5-4020-94f0-0a1f7ec91173" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.447978] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad1f2977-cba5-4020-94f0-0a1f7ec91173',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.551693] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.551978] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.552540] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.552540] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.552718] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.552796] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 327722fe-c5c2-466f-92ca-c218e5304f72 not found, creating... [ 742.553058] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.554098] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.554242] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.554687] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.555488] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.556301] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.556621] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.556685] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.556906] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.557504] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.557504] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 327722fe-c5c2-466f-92ca-c218e5304f72 is going to be created. [ 742.561315] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.561437] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.561600] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.562413] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.562413] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.562413] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 65b8c00f-8a84-4930-a8b4-c7a8e994421b not found, creating... [ 742.562413] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.562772] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.562772] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.562957] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.564045] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.564045] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.564045] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.564045] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.564524] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.564524] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.564524] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 65b8c00f-8a84-4930-a8b4-c7a8e994421b is going to be created. [ 742.584037] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.584037] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.584037] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.584037] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.584499] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.584499] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-327722fe-c5c2-466f-92ca-c218e5304f72" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.587130] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3334dcf0-49ba-4e8b-90d4-14df2863e5f2: rpc.has_security_group_logging(os_id): False [ 742.594028] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.594028] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.594028] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.594028] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.597594] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.597594] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-65b8c00f-8a84-4930-a8b4-c7a8e994421b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.608281] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.608426] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.610125] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.610125] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.610125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.610761] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.610761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.610761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.610761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.610761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.610761] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 is going to be created. [ 742.755573] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.758034] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.758034] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.758034] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.758034] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.784929] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 in Status: IN_PROGRESS for 2s [ 742.951393] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad1f2977-cba5-4020-94f0-0a1f7ec91173 [ 742.951550] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.952156] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.952156] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.952156] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.952156] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.952543] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad1f2977-cba5-4020-94f0-0a1f7ec91173 already deleted. [ 742.952543] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad1f2977-cba5-4020-94f0-0a1f7ec91173" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.644869] env[69789]: INFO networking_nsxv3.common.synchronization [None req-cee7ca1c-65e6-4a45-b7fe-07227d0ee35a None None] Enqueued Resource ID: 6d96b9ec-6cdb-4099-964b-a8b016976eb5 with Priority: HIGHEST for action port [ 743.647891] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d96b9ec-6cdb-4099-964b-a8b016976eb5 with Priority: HIGHEST for action port [ 743.647891] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d96b9ec-6cdb-4099-964b-a8b016976eb5 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.648021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d96b9ec-6cdb-4099-964b-a8b016976eb5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.648021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d96b9ec-6cdb-4099-964b-a8b016976eb5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.648316] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d96b9ec-6cdb-4099-964b-a8b016976eb5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.648417] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d96b9ec-6cdb-4099-964b-a8b016976eb5',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.883799] env[69789]: INFO networking_nsxv3.common.synchronization [req-4bef1b05-a9b6-4419-9629-4c2bba7b2c1a req-b0617cdb-7a26-4753-8e3f-1af646fa51ae service nova] Enqueued Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_rules [ 743.883799] env[69789]: INFO networking_nsxv3.common.synchronization [req-4bef1b05-a9b6-4419-9629-4c2bba7b2c1a req-b0617cdb-7a26-4753-8e3f-1af646fa51ae service nova] Enqueued Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_members [ 743.883799] env[69789]: INFO networking_nsxv3.common.synchronization [req-4bef1b05-a9b6-4419-9629-4c2bba7b2c1a req-b0617cdb-7a26-4753-8e3f-1af646fa51ae service nova] Enqueued Resource ID: 65b8c00f-8a84-4930-a8b4-c7a8e994421b with Priority: HIGHEST for action port [ 743.883799] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_rules [ 743.883799] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_members [ 743.883799] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65b8c00f-8a84-4930-a8b4-c7a8e994421b with Priority: HIGHEST for action port [ 743.883799] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.883799] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.883799] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.883799] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.883799] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.885374] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.885601] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.885680] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.886000] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.886113] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.886559] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.886709] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.887136] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.887329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.887446] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.888817] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-65b8c00f-8a84-4930-a8b4-c7a8e994421b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.889079] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65b8c00f-8a84-4930-a8b4-c7a8e994421b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.889139] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65b8c00f-8a84-4930-a8b4-c7a8e994421b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.889329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65b8c00f-8a84-4930-a8b4-c7a8e994421b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.889451] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65b8c00f-8a84-4930-a8b4-c7a8e994421b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.974710] env[69789]: INFO networking_nsxv3.common.synchronization [None req-eba88f23-c7ac-46d0-b818-e5918b92e2fe None None] Enqueued Resource ID: 5529308c-ef27-449e-abf6-66889f6fdba3 with Priority: HIGHEST for action port [ 743.975572] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5529308c-ef27-449e-abf6-66889f6fdba3 with Priority: HIGHEST for action port [ 743.976195] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-5529308c-ef27-449e-abf6-66889f6fdba3 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.976709] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5529308c-ef27-449e-abf6-66889f6fdba3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.976709] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5529308c-ef27-449e-abf6-66889f6fdba3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.976892] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5529308c-ef27-449e-abf6-66889f6fdba3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.977022] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5529308c-ef27-449e-abf6-66889f6fdba3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.143009] env[69789]: INFO networking_nsxv3.common.synchronization [req-e664f57d-0a2e-4fe6-9820-35a812e71814 req-97bc99dc-c462-4fd9-8a6b-f9ab1ffd229f service nova] Enqueued Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGHEST for action security_group_rules [ 744.143009] env[69789]: INFO networking_nsxv3.common.synchronization [req-e664f57d-0a2e-4fe6-9820-35a812e71814 req-97bc99dc-c462-4fd9-8a6b-f9ab1ffd229f service nova] Enqueued Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGHEST for action security_group_members [ 744.143009] env[69789]: INFO networking_nsxv3.common.synchronization [req-e664f57d-0a2e-4fe6-9820-35a812e71814 req-97bc99dc-c462-4fd9-8a6b-f9ab1ffd229f service nova] Enqueued Resource ID: 327722fe-c5c2-466f-92ca-c218e5304f72 with Priority: HIGHEST for action port [ 744.143291] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGHEST for action security_group_rules [ 744.143418] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGHEST for action security_group_members [ 744.143893] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327722fe-c5c2-466f-92ca-c218e5304f72 with Priority: HIGHEST for action port [ 744.146987] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b546181-293b-47af-ad81-70b5a00fd2e3 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.146987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.146987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.146987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.146987] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.146987] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b546181-293b-47af-ad81-70b5a00fd2e3 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.146987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.146987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.146987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.146987] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.146987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.146987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.147830] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.147830] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.147830] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.148515] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-327722fe-c5c2-466f-92ca-c218e5304f72 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.148515] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-327722fe-c5c2-466f-92ca-c218e5304f72" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.148705] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-327722fe-c5c2-466f-92ca-c218e5304f72" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.148739] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-327722fe-c5c2-466f-92ca-c218e5304f72" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.148820] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('327722fe-c5c2-466f-92ca-c218e5304f72',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.151937] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d96b9ec-6cdb-4099-964b-a8b016976eb5 [ 744.151937] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.151937] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.151937] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.152136] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.152136] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.152795] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d96b9ec-6cdb-4099-964b-a8b016976eb5 already deleted. [ 744.152795] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d96b9ec-6cdb-4099-964b-a8b016976eb5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.391695] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.391843] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.392022] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.393096] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65b8c00f-8a84-4930-a8b4-c7a8e994421b with status ACTIVE [ 744.393150] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.393586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.393586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.393586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.393586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.393586] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.393586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.393586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.394226] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.394226] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.394583] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.394583] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.394583] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.394717] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.394717] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.394782] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65b8c00f-8a84-4930-a8b4-c7a8e994421b is going to be updated. [ 744.424090] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.424246] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.424511] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.424511] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.424695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.424760] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65b8c00f-8a84-4930-a8b4-c7a8e994421b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.440410] env[69789]: INFO networking_nsxv3.common.synchronization [None req-18ba1b88-995b-4978-aa1c-d2dbabaf0ea3 None None] Enqueued Resource ID: 8cabe1f0-e476-4e87-a05d-bcbf40abc20d with Priority: HIGHEST for action port [ 744.440410] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cabe1f0-e476-4e87-a05d-bcbf40abc20d with Priority: HIGHEST for action port [ 744.440410] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cabe1f0-e476-4e87-a05d-bcbf40abc20d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.440410] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cabe1f0-e476-4e87-a05d-bcbf40abc20d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.440410] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cabe1f0-e476-4e87-a05d-bcbf40abc20d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.440804] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cabe1f0-e476-4e87-a05d-bcbf40abc20d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.440804] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cabe1f0-e476-4e87-a05d-bcbf40abc20d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.480354] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5529308c-ef27-449e-abf6-66889f6fdba3 [ 744.480354] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.480354] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.480354] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.480575] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.480609] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.480724] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5529308c-ef27-449e-abf6-66889f6fdba3 already deleted. [ 744.480826] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5529308c-ef27-449e-abf6-66889f6fdba3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.651786] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.652712] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b546181-293b-47af-ad81-70b5a00fd2e3 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.652833] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.653678] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 327722fe-c5c2-466f-92ca-c218e5304f72 with status ACTIVE [ 744.653678] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.653678] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.653678] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.653678] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.653678] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.655220] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.655220] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.655220] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.655220] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.655220] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.655220] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.655220] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.655220] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.655677] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.655677] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.655808] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 327722fe-c5c2-466f-92ca-c218e5304f72 is going to be updated. [ 744.682795] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.683018] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.683018] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.683913] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.683913] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.683913] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-327722fe-c5c2-466f-92ca-c218e5304f72" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.726107] env[69789]: INFO networking_nsxv3.common.synchronization [req-ad7a4035-c72c-469c-ac77-b178641e8fc3 req-84153ba8-ef05-49f1-bce5-d83828121a9e tempest-TenantUsagesTestJSON-1751090999 tempest-TenantUsagesTestJSON-1751090999-project-member] Enqueued Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGHEST for action security_group_members [ 744.726107] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGHEST for action security_group_members [ 744.726107] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a60025-1a74-47a6-8a27-9b49e8f20582 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.726107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.726107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.726107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.726107] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.726107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.726107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.726107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.726107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.726107] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.803432] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 in Status: SUCCESS [ 744.804206] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.899202] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.947295] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cabe1f0-e476-4e87-a05d-bcbf40abc20d [ 744.947752] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.947752] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.947752] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.948250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.948250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.948250] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cabe1f0-e476-4e87-a05d-bcbf40abc20d already deleted. [ 744.948250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cabe1f0-e476-4e87-a05d-bcbf40abc20d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.153625] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.195275] env[69789]: INFO networking_nsxv3.common.synchronization [None req-fdecd907-1d43-4abd-a405-c18ef5d21bee None None] Enqueued Resource ID: f17f703b-43e4-4701-a7a6-d0d37084af44 with Priority: HIGHEST for action port [ 745.195844] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f17f703b-43e4-4701-a7a6-d0d37084af44 with Priority: HIGHEST for action port [ 745.196172] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-f17f703b-43e4-4701-a7a6-d0d37084af44 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.196299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f17f703b-43e4-4701-a7a6-d0d37084af44" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.196495] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f17f703b-43e4-4701-a7a6-d0d37084af44" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.196763] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f17f703b-43e4-4701-a7a6-d0d37084af44" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.196847] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f17f703b-43e4-4701-a7a6-d0d37084af44',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.230185] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.230185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.230185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.230369] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.230399] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.230579] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.230678] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.230739] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.230906] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.230997] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.231101] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 already deleted. [ 745.231183] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.287141] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.290036] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.290036] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.290036] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.290036] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.290036] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.290036] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.290036] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.290036] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.290411] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.292703] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.292703] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.292703] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.292703] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.292703] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.292703] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.309658] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.309962] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.310177] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.311052] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-499" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.311818] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-71d51eb3-e59f-4936-81b5-e8153da0b686 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.313453] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-71d51eb3-e59f-4936-81b5-e8153da0b686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.313737] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-71d51eb3-e59f-4936-81b5-e8153da0b686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.314255] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-71d51eb3-e59f-4936-81b5-e8153da0b686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.314482] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d51eb3-e59f-4936-81b5-e8153da0b686',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.405182] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.405182] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.405182] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.405182] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.405182] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.405182] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e is going to be created. [ 745.436205] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.436366] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.436427] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.436669] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.436836] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.447947] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e in Status: UNINITIALIZED for 2s [ 745.656796] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.657088] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.657088] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.657274] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.657361] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.657458] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 is going to be created. [ 745.685576] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.685751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.685855] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.686161] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.686323] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.700619] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 in Status: UNINITIALIZED for 2s [ 745.700833] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f17f703b-43e4-4701-a7a6-d0d37084af44 [ 745.701050] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.701179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.701239] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.701460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.701534] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.701629] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f17f703b-43e4-4701-a7a6-d0d37084af44 already deleted. [ 745.701708] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f17f703b-43e4-4701-a7a6-d0d37084af44" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.816534] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.816784] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.816913] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.817454] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.817566] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.817662] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 71d51eb3-e59f-4936-81b5-e8153da0b686 not found, creating... [ 745.817935] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.818758] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.818758] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.818758] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.818758] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.818917] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.819020] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.819155] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.819410] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.819579] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.819742] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 71d51eb3-e59f-4936-81b5-e8153da0b686 is going to be created. [ 745.845822] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.846031] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.846215] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.846488] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.847235] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.847235] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-71d51eb3-e59f-4936-81b5-e8153da0b686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.588112] env[69789]: INFO networking_nsxv3.common.synchronization [None req-d4c6172d-398a-4c31-bfc9-ee728648a4c2 None None] Enqueued Resource ID: 14826a7d-7bf8-411f-bce5-ecf5c5539070 with Priority: HIGHEST for action port [ 746.588112] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14826a7d-7bf8-411f-bce5-ecf5c5539070 with Priority: HIGHEST for action port [ 746.588407] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-14826a7d-7bf8-411f-bce5-ecf5c5539070 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.588557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14826a7d-7bf8-411f-bce5-ecf5c5539070" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.588625] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14826a7d-7bf8-411f-bce5-ecf5c5539070" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.589177] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14826a7d-7bf8-411f-bce5-ecf5c5539070" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.589282] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14826a7d-7bf8-411f-bce5-ecf5c5539070',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.698026] env[69789]: INFO networking_nsxv3.common.synchronization [req-ad7a4035-c72c-469c-ac77-b178641e8fc3 req-fc889979-f549-4305-a76e-ea8c778c181c service nova] Enqueued Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGHEST for action security_group_rules [ 746.698026] env[69789]: INFO networking_nsxv3.common.synchronization [req-ad7a4035-c72c-469c-ac77-b178641e8fc3 req-fc889979-f549-4305-a76e-ea8c778c181c service nova] Enqueued Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGHEST for action security_group_members [ 746.698026] env[69789]: INFO networking_nsxv3.common.synchronization [req-ad7a4035-c72c-469c-ac77-b178641e8fc3 req-fc889979-f549-4305-a76e-ea8c778c181c service nova] Enqueued Resource ID: 71d51eb3-e59f-4936-81b5-e8153da0b686 with Priority: HIGHEST for action port [ 746.699520] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGHEST for action security_group_rules [ 746.701840] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGHEST for action security_group_members [ 746.701840] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d51eb3-e59f-4936-81b5-e8153da0b686 with Priority: HIGHEST for action port [ 746.701840] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a60025-1a74-47a6-8a27-9b49e8f20582 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.701840] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.701840] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.701840] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.701840] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.702480] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a60025-1a74-47a6-8a27-9b49e8f20582 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.702480] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.702480] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.702948] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.703188] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.703489] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.703554] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.703774] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.703897] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.704077] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.705401] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-71d51eb3-e59f-4936-81b5-e8153da0b686 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.705589] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71d51eb3-e59f-4936-81b5-e8153da0b686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.705686] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71d51eb3-e59f-4936-81b5-e8153da0b686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.705904] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71d51eb3-e59f-4936-81b5-e8153da0b686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.706018] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d51eb3-e59f-4936-81b5-e8153da0b686',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.958267] env[69789]: INFO networking_nsxv3.common.synchronization [req-ada60481-7664-4b51-a578-4438d15e4513 req-14c8fec7-c15d-4a35-9609-3cd82eef2bda tempest-SecurityGroupRulesTestJSON-798938365 tempest-SecurityGroupRulesTestJSON-798938365-project-member] Enqueued Resource ID: b779558a-1f81-480a-963c-400a5b6e041d with Priority: HIGHEST for action security_group_rules [ 746.958795] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b779558a-1f81-480a-963c-400a5b6e041d with Priority: HIGHEST for action security_group_rules [ 746.959116] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b779558a-1f81-480a-963c-400a5b6e041d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.960071] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b779558a-1f81-480a-963c-400a5b6e041d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.960071] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b779558a-1f81-480a-963c-400a5b6e041d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.960220] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b779558a-1f81-480a-963c-400a5b6e041d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.961064] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b779558a-1f81-480a-963c-400a5b6e041d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.095242] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14826a7d-7bf8-411f-bce5-ecf5c5539070 [ 747.095242] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.095242] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.095242] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.095242] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.095242] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.095242] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14826a7d-7bf8-411f-bce5-ecf5c5539070 already deleted. [ 747.095242] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14826a7d-7bf8-411f-bce5-ecf5c5539070" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.208920] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a60025-1a74-47a6-8a27-9b49e8f20582 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.209540] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.209899] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.210877] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71d51eb3-e59f-4936-81b5-e8153da0b686 with status ACTIVE [ 747.211116] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.211268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.211430] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.211584] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.211682] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.211902] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.212010] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.213386] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.213582] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.214865] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.215132] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.215224] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.215301] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.215481] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.215564] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.215691] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71d51eb3-e59f-4936-81b5-e8153da0b686 is going to be updated. [ 747.243163] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.243163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.243163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.243163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.243163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.243163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71d51eb3-e59f-4936-81b5-e8153da0b686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.460411] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e in Status: SUCCESS [ 747.460696] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.460918] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.463055] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.463055] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.463055] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.463055] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.463055] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.463055] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.463055] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.463055] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.494546] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.494733] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.494976] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.495085] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.495346] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.495346] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b779558a-1f81-480a-963c-400a5b6e041d already deleted. [ 747.495484] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b779558a-1f81-480a-963c-400a5b6e041d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.710639] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 in Status: SUCCESS [ 747.710929] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.711011] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.711291] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.711678] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.711678] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.711678] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.711844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.711890] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.711999] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.712076] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.720215] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.966526] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.221530] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b546181-293b-47af-ad81-70b5a00fd2e3 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.221530] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.221530] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.221530] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.221768] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.221768] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.221870] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.222809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.222809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.222809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.222809] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b546181-293b-47af-ad81-70b5a00fd2e3 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.222809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.222809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.222809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.222809] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.223194] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.223194] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.223194] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.223194] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.223194] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.223355] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.224941] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.225037] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.225102] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.225243] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.225411] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.225515] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 is going to be created. [ 748.277616] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.278034] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.278034] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.278197] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.278429] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.300488] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 in Status: UNINITIALIZED for 2s [ 748.469582] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e: rpc.has_security_group_logging(os_id): False [ 748.492580] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.492818] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.492818] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.493035] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.493163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.493524] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.493524] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.493711] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.493778] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.493854] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.493945] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e is going to be created. [ 748.531463] env[69789]: INFO networking_nsxv3.common.synchronization [None req-e0ae113d-ffaf-4997-8b82-24e79dbfd44d None None] Enqueued Resource ID: 542633a0-b7ee-474d-8baf-3e16513586a1 with Priority: HIGHEST for action port [ 748.531894] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542633a0-b7ee-474d-8baf-3e16513586a1 with Priority: HIGHEST for action port [ 748.532574] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-542633a0-b7ee-474d-8baf-3e16513586a1 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.532692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-542633a0-b7ee-474d-8baf-3e16513586a1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.532692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-542633a0-b7ee-474d-8baf-3e16513586a1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.532920] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-542633a0-b7ee-474d-8baf-3e16513586a1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.533014] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('542633a0-b7ee-474d-8baf-3e16513586a1',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.556027] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.556027] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.556213] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.556274] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.556537] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.568285] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e in Status: IN_PROGRESS for 2s [ 748.728783] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b546181-293b-47af-ad81-70b5a00fd2e3: rpc.has_security_group_logging(os_id): False [ 748.753279] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.753279] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.753279] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.753279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.754077] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.754077] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.754077] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.754077] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.754077] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.754759] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 is going to be created. [ 748.845308] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.845308] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.845308] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.845308] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.845308] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.859177] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 in Status: IN_PROGRESS for 2s [ 749.037381] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 542633a0-b7ee-474d-8baf-3e16513586a1 [ 749.037875] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.039316] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.039608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.039965] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.040052] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.040163] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:542633a0-b7ee-474d-8baf-3e16513586a1 already deleted. [ 749.040276] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-542633a0-b7ee-474d-8baf-3e16513586a1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.088976] env[69789]: INFO networking_nsxv3.common.synchronization [None req-73474c16-7ade-4435-920f-7ea4d862369f None None] Enqueued Resource ID: f1311238-abf5-42e7-8b6a-260e0515c455 with Priority: HIGHEST for action port [ 749.089681] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1311238-abf5-42e7-8b6a-260e0515c455 with Priority: HIGHEST for action port [ 749.091339] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1311238-abf5-42e7-8b6a-260e0515c455 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.091528] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1311238-abf5-42e7-8b6a-260e0515c455" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.091566] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1311238-abf5-42e7-8b6a-260e0515c455" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.091804] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1311238-abf5-42e7-8b6a-260e0515c455" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.091887] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1311238-abf5-42e7-8b6a-260e0515c455',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.467420] env[69789]: INFO networking_nsxv3.common.synchronization [req-9db79df3-ba7a-4f11-ac49-d00365bfa292 req-0f06c463-b87f-4e3c-b778-e1973b77f147 tempest-SecurityGroupRulesNegativeTestJSON-533714139 tempest-SecurityGroupRulesNegativeTestJSON-533714139-project-member] Enqueued Resource ID: f635992c-7174-4e88-a5da-bfd1c1a2b4db with Priority: HIGHEST for action security_group_rules [ 749.467420] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f635992c-7174-4e88-a5da-bfd1c1a2b4db with Priority: HIGHEST for action security_group_rules [ 749.467420] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.467828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.470453] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.470453] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.470453] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f635992c-7174-4e88-a5da-bfd1c1a2b4db',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.595377] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1311238-abf5-42e7-8b6a-260e0515c455 [ 749.595377] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.595377] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.595377] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.595377] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.595377] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.595377] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1311238-abf5-42e7-8b6a-260e0515c455 already deleted. [ 749.595377] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1311238-abf5-42e7-8b6a-260e0515c455" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.996807] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.997150] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.997150] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.997268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.997363] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.997488] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f635992c-7174-4e88-a5da-bfd1c1a2b4db already deleted. [ 749.997588] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.317662] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 in Status: SUCCESS [ 750.317915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.318588] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.318588] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.318588] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.319166] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.319166] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.319166] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.319694] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.321342] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.321342] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.580391] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e in Status: SUCCESS [ 750.580673] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.826599] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a60025-1a74-47a6-8a27-9b49e8f20582 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.827289] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.827289] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.827289] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.827289] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.827518] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.827518] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.827605] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.827661] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.827752] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.827892] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a60025-1a74-47a6-8a27-9b49e8f20582 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.827985] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.828255] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.828255] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.828348] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.828408] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.828452] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.828580] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.828882] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.828974] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.829087] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.874045] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 in Status: SUCCESS [ 750.874294] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.333253] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50a60025-1a74-47a6-8a27-9b49e8f20582: rpc.has_security_group_logging(os_id): False [ 751.357725] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.357725] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.358058] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.358117] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.358223] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.358511] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.358578] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.358611] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.358760] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.358838] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.359019] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.359499] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.359651] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.359892] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.359957] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.360264] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.361041] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.361194] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.361436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.361561] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.361691] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 is going to be created. [ 751.443397] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.443598] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.444406] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.444692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.444937] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.470722] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 in Status: IN_PROGRESS for 2s [ 751.558208] env[69789]: INFO networking_nsxv3.common.synchronization [req-9b5d8c27-b089-44ed-904e-0d412a946cb7 req-ae6619e2-a7a2-49bc-875d-7a25a9bee82f tempest-DeleteServersAdminTestJSON-518039465 tempest-DeleteServersAdminTestJSON-518039465-project-admin] Enqueued Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGHEST for action security_group_members [ 751.558443] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGHEST for action security_group_members [ 751.559042] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.559171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.559239] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.560691] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.560875] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.560991] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.561071] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.561238] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.561326] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.561423] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.067957] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.068155] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.068223] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.069324] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.069484] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.069830] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.069830] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.069830] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.070043] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.070133] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.070208] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 is going to be updated. [ 752.106218] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.106631] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.106814] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.107122] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.107359] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.119814] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 in Status: IN_PROGRESS for 2s [ 752.304676] env[69789]: INFO networking_nsxv3.common.synchronization [None req-c10c4532-4e75-4e67-8d40-176317963dc9 None None] Enqueued Resource ID: 37ffc72d-db1d-4212-b90e-98591010c93d with Priority: HIGHEST for action port [ 752.304901] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ffc72d-db1d-4212-b90e-98591010c93d with Priority: HIGHEST for action port [ 752.305527] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-37ffc72d-db1d-4212-b90e-98591010c93d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.305659] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37ffc72d-db1d-4212-b90e-98591010c93d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.305857] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37ffc72d-db1d-4212-b90e-98591010c93d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.305985] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37ffc72d-db1d-4212-b90e-98591010c93d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.307007] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37ffc72d-db1d-4212-b90e-98591010c93d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.809751] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37ffc72d-db1d-4212-b90e-98591010c93d [ 752.810133] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.810333] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.810442] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.810909] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.811035] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.811212] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37ffc72d-db1d-4212-b90e-98591010c93d already deleted. [ 752.811335] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37ffc72d-db1d-4212-b90e-98591010c93d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.484542] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 in Status: SUCCESS [ 753.484784] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.769860] env[69789]: INFO networking_nsxv3.common.synchronization [req-c542b4b6-f8bf-4763-99c2-8b291317b21d req-13c523e6-3949-4f64-bb6f-ab5d036bc28d tempest-SecurityGroupRulesNegativeTestJSON-533714139 tempest-SecurityGroupRulesNegativeTestJSON-533714139-project-member] Enqueued Resource ID: f635992c-7174-4e88-a5da-bfd1c1a2b4db with Priority: HIGHEST for action security_group_rules [ 753.770582] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f635992c-7174-4e88-a5da-bfd1c1a2b4db with Priority: HIGHEST for action security_group_rules [ 753.771228] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.771228] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.771228] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.771397] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.771397] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f635992c-7174-4e88-a5da-bfd1c1a2b4db',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.130658] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 in Status: SUCCESS [ 754.130967] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 deletion is rescheduled due to dependency. [ 754.130967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.295627] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.295866] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.295866] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.296273] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.296501] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.296852] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f635992c-7174-4e88-a5da-bfd1c1a2b4db already deleted. [ 754.296852] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f635992c-7174-4e88-a5da-bfd1c1a2b4db" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.327214] env[69789]: INFO networking_nsxv3.common.synchronization [None req-eda03dfb-409d-440b-b2cf-efec06348762 None None] Enqueued Resource ID: b7aaaca7-6887-4dfd-9dd7-195c96dc3519 with Priority: HIGHEST for action port [ 754.327214] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7aaaca7-6887-4dfd-9dd7-195c96dc3519 with Priority: HIGHEST for action port [ 754.327295] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7aaaca7-6887-4dfd-9dd7-195c96dc3519 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.327774] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7aaaca7-6887-4dfd-9dd7-195c96dc3519" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.327774] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7aaaca7-6887-4dfd-9dd7-195c96dc3519" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.328039] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7aaaca7-6887-4dfd-9dd7-195c96dc3519" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.328148] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7aaaca7-6887-4dfd-9dd7-195c96dc3519',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.831747] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7aaaca7-6887-4dfd-9dd7-195c96dc3519 [ 754.832160] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.832399] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.832475] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.832769] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.832915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.833055] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7aaaca7-6887-4dfd-9dd7-195c96dc3519 already deleted. [ 754.833187] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7aaaca7-6887-4dfd-9dd7-195c96dc3519" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.701709] env[69789]: INFO networking_nsxv3.common.synchronization [req-212619c8-1268-4888-85d0-f273ed781be2 req-3317ab41-7542-4899-995c-614ffe150aef tempest-SecurityGroupRulesTestJSON-798938365 tempest-SecurityGroupRulesTestJSON-798938365-project-member] Enqueued Resource ID: 32582c2f-c1cd-408e-b1a9-980d2191f90d with Priority: HIGHEST for action security_group_rules [ 755.702388] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32582c2f-c1cd-408e-b1a9-980d2191f90d with Priority: HIGHEST for action security_group_rules [ 755.702550] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32582c2f-c1cd-408e-b1a9-980d2191f90d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.703762] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.703762] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.706394] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.706519] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32582c2f-c1cd-408e-b1a9-980d2191f90d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.985222] env[69789]: INFO networking_nsxv3.common.synchronization [req-900fdd96-de2a-4f34-91e3-1ca364399132 req-3f980204-6ba1-4a1d-91c6-78bc55b597dc tempest-AttachInterfacesV270Test-221984682 tempest-AttachInterfacesV270Test-221984682-project-member] Enqueued Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGHEST for action security_group_members [ 755.985222] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGHEST for action security_group_members [ 755.985222] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f9994a9-d5bc-4285-9c21-cc72e521d44e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.985222] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.985222] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.985222] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.985668] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.985888] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.986053] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.986305] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.986546] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.986738] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.231219] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.231219] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.231219] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.231219] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.231219] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.231219] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32582c2f-c1cd-408e-b1a9-980d2191f90d already deleted. [ 756.231219] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.489181] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.493029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.493029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.493029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.493029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.493029] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.493029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.493029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.493029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.493029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.493029] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e is going to be updated. [ 756.537396] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.537643] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.537756] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.537984] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.538148] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.552668] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e in Status: IN_PROGRESS for 2s [ 757.058939] env[69789]: INFO networking_nsxv3.common.synchronization [None req-621ce8e1-4bea-4e51-a456-ce5f99c2ddda None None] Enqueued Resource ID: e283aae5-242b-40c1-a8e6-44801ce38fd8 with Priority: HIGHEST for action port [ 757.064460] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e283aae5-242b-40c1-a8e6-44801ce38fd8 with Priority: HIGHEST for action port [ 757.064460] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-e283aae5-242b-40c1-a8e6-44801ce38fd8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.064460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e283aae5-242b-40c1-a8e6-44801ce38fd8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.064460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e283aae5-242b-40c1-a8e6-44801ce38fd8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.064460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e283aae5-242b-40c1-a8e6-44801ce38fd8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.064460] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e283aae5-242b-40c1-a8e6-44801ce38fd8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.297752] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a2f0dcc2-304e-4a1b-9be8-d4a2803a6bf4 None None] Enqueued Resource ID: c33a325c-cf7b-4f0f-a022-4f415e5429ce with Priority: HIGHEST for action port [ 757.298314] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33a325c-cf7b-4f0f-a022-4f415e5429ce with Priority: HIGHEST for action port [ 757.299397] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-c33a325c-cf7b-4f0f-a022-4f415e5429ce taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.299397] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c33a325c-cf7b-4f0f-a022-4f415e5429ce" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.299397] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c33a325c-cf7b-4f0f-a022-4f415e5429ce" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.302030] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c33a325c-cf7b-4f0f-a022-4f415e5429ce" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.302030] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c33a325c-cf7b-4f0f-a022-4f415e5429ce',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.528920] env[69789]: INFO networking_nsxv3.common.synchronization [None req-bc22e5c5-2766-4ce6-8539-2463f8dfba6b tempest-ServersTestManualDisk-1605649959 tempest-ServersTestManualDisk-1605649959-project-member] Enqueued Resource ID: 27703b82-1164-4559-bf86-622c5df4945b with Priority: HIGHEST for action security_group_rules [ 757.529600] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27703b82-1164-4559-bf86-622c5df4945b with Priority: HIGHEST for action security_group_rules [ 757.529939] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27703b82-1164-4559-bf86-622c5df4945b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.530109] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27703b82-1164-4559-bf86-622c5df4945b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.530156] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27703b82-1164-4559-bf86-622c5df4945b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.530424] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27703b82-1164-4559-bf86-622c5df4945b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.530541] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27703b82-1164-4559-bf86-622c5df4945b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.563379] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e283aae5-242b-40c1-a8e6-44801ce38fd8 [ 757.563938] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.566437] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.566437] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.566437] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.566437] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.566437] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e283aae5-242b-40c1-a8e6-44801ce38fd8 already deleted. [ 757.566437] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e283aae5-242b-40c1-a8e6-44801ce38fd8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.670097] env[69789]: INFO networking_nsxv3.common.synchronization [None req-b7b967e1-0753-4007-a78f-be58f53d7190 tempest-ServersTestManualDisk-1605649959 tempest-ServersTestManualDisk-1605649959-project-member] Enqueued Resource ID: 27703b82-1164-4559-bf86-622c5df4945b with Priority: HIGHEST for action security_group_rules [ 757.671410] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27703b82-1164-4559-bf86-622c5df4945b with Priority: HIGHEST for action security_group_rules [ 757.671687] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27703b82-1164-4559-bf86-622c5df4945b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.671836] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27703b82-1164-4559-bf86-622c5df4945b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.802985] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c33a325c-cf7b-4f0f-a022-4f415e5429ce [ 757.803349] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.803555] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.803699] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.803956] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.804118] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.804263] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c33a325c-cf7b-4f0f-a022-4f415e5429ce already deleted. [ 757.804401] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c33a325c-cf7b-4f0f-a022-4f415e5429ce" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.056788] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.056788] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.056788] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.057040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.057132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.057234] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27703b82-1164-4559-bf86-622c5df4945b already deleted. [ 758.057324] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27703b82-1164-4559-bf86-622c5df4945b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.057487] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27703b82-1164-4559-bf86-622c5df4945b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.057650] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27703b82-1164-4559-bf86-622c5df4945b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.058112] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27703b82-1164-4559-bf86-622c5df4945b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.071306] env[69789]: INFO networking_nsxv3.common.synchronization [req-f854b18e-f112-4cc2-95d5-0a8db3889c4b req-85718fa5-004e-4562-838b-148e39b5963a tempest-SecurityGroupRulesTestJSON-798938365 tempest-SecurityGroupRulesTestJSON-798938365-project-member] Enqueued Resource ID: 32582c2f-c1cd-408e-b1a9-980d2191f90d with Priority: HIGHEST for action security_group_rules [ 758.072770] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32582c2f-c1cd-408e-b1a9-980d2191f90d with Priority: HIGHEST for action security_group_rules [ 758.072770] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32582c2f-c1cd-408e-b1a9-980d2191f90d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.072770] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.072770] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.073131] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.073131] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32582c2f-c1cd-408e-b1a9-980d2191f90d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.115455] env[69789]: INFO networking_nsxv3.common.synchronization [req-6ceb92f1-3ab7-4b1e-8f31-461a4c68421b req-28df2c0c-ff84-4b34-aa5c-2416a956587e tempest-ServerExternalEventsTest-763372503 tempest-ServerExternalEventsTest-763372503-project-member] Enqueued Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGHEST for action security_group_members [ 758.116125] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGHEST for action security_group_members [ 758.116330] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.116459] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.116528] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.118212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.118212] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.118212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.118212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.118212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.118212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.118212] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.564180] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e in Status: SUCCESS [ 758.564424] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e deletion is rescheduled due to dependency. [ 758.565055] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.581609] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.581733] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.581733] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.581925] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.582021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.582121] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27703b82-1164-4559-bf86-622c5df4945b already deleted. [ 758.582207] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27703b82-1164-4559-bf86-622c5df4945b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.593317] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.593481] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.593548] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.593968] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.593968] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.593968] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32582c2f-c1cd-408e-b1a9-980d2191f90d already deleted. [ 758.593968] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.623074] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.623074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.623074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.623074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.623074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.623074] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.623074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.623074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.623074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.623074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.623074] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 is going to be updated. [ 758.656322] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.656322] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.656322] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.656322] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.656583] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.668506] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 in Status: IN_PROGRESS for 2s [ 759.593707] env[69789]: INFO networking_nsxv3.common.synchronization [req-b770e4ed-c2e7-4902-bccd-6ace6a8617a1 req-cee68d8c-0104-4dce-997b-f27c9540f370 tempest-VolumesAdminNegativeTest-161696083 tempest-VolumesAdminNegativeTest-161696083-project-member] Enqueued Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_members [ 759.595456] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_members [ 759.598721] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-367b3953-c384-4a92-8d77-5aeea593412d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.598721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.598721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.598721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.598721] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.598721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.598721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.598721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.598721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.598721] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.999131] env[69789]: INFO networking_nsxv3.common.synchronization [None req-fe8b1b4e-6a4c-442b-bdd5-70a66f2e1997 None None] Enqueued Resource ID: ed84f857-732a-46cf-bcc1-6e8e485f6004 with Priority: HIGHEST for action port [ 759.999395] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed84f857-732a-46cf-bcc1-6e8e485f6004 with Priority: HIGHEST for action port [ 760.000017] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed84f857-732a-46cf-bcc1-6e8e485f6004 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.002019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed84f857-732a-46cf-bcc1-6e8e485f6004" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.002019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed84f857-732a-46cf-bcc1-6e8e485f6004" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.005214] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed84f857-732a-46cf-bcc1-6e8e485f6004" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.005214] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed84f857-732a-46cf-bcc1-6e8e485f6004',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.102810] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.103015] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.103071] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.103831] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.103831] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.103831] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.103831] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.103831] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.104072] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.104072] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.104144] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 367b3953-c384-4a92-8d77-5aeea593412d already deleted. [ 760.104229] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.504743] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed84f857-732a-46cf-bcc1-6e8e485f6004 [ 760.505551] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.505951] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.506853] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.507121] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.507218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.507324] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed84f857-732a-46cf-bcc1-6e8e485f6004 already deleted. [ 760.507410] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed84f857-732a-46cf-bcc1-6e8e485f6004" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.681708] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 in Status: SUCCESS [ 760.682013] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 deletion is rescheduled due to dependency. [ 760.682436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.693811] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.693998] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-772" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.694136] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-772" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.694558] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-772" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.694961] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.695600] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.695725] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.695970] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.696131] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.696366] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.696493] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.696602] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.696706] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.696986] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.696986] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.697073] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.721870] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.722065] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 760.722203] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.722426] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-772" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.722774] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.722945] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.723087] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.723448] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.723880] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c9189a9-01dd-42e1-b2b3-9d0f3f53448e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.230780] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.230780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.230780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.230780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.230780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.230780] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 3c9189a9-01dd-42e1-b2b3-9d0f3f53448e not found, creating... [ 761.230780] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.230780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.230780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.230780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.230780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.231566] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.231566] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.231566] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.232945] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.232945] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.232945] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 3c9189a9-01dd-42e1-b2b3-9d0f3f53448e is going to be created. [ 761.265761] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.265978] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.266189] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.266389] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.266859] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.267174] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.319390] env[69789]: INFO networking_nsxv3.common.synchronization [None req-348c4dff-39c1-4f53-8bfb-ddd037b3466e None None] Enqueued Resource ID: e9433ca9-0f02-4d14-a6cd-48994c410679 with Priority: HIGHEST for action port [ 761.319390] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9433ca9-0f02-4d14-a6cd-48994c410679 with Priority: HIGHEST for action port [ 761.321980] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9433ca9-0f02-4d14-a6cd-48994c410679 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.322675] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9433ca9-0f02-4d14-a6cd-48994c410679" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.322675] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9433ca9-0f02-4d14-a6cd-48994c410679" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.323062] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9433ca9-0f02-4d14-a6cd-48994c410679" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.323860] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9433ca9-0f02-4d14-a6cd-48994c410679',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.617415] env[69789]: INFO networking_nsxv3.common.synchronization [req-93348724-5a2f-4e8c-b291-dbb4c1101f89 req-b3a5110a-38fb-4366-bbe4-4e8ce5174985 tempest-SecurityGroupRulesTestJSON-798938365 tempest-SecurityGroupRulesTestJSON-798938365-project-member] Enqueued Resource ID: 32582c2f-c1cd-408e-b1a9-980d2191f90d with Priority: HIGHEST for action security_group_rules [ 761.617415] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32582c2f-c1cd-408e-b1a9-980d2191f90d with Priority: HIGHEST for action security_group_rules [ 761.617415] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32582c2f-c1cd-408e-b1a9-980d2191f90d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.617415] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.619279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.619279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.619279] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32582c2f-c1cd-408e-b1a9-980d2191f90d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.826399] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9433ca9-0f02-4d14-a6cd-48994c410679 [ 761.826784] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.826978] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.827105] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.827423] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.827484] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.827597] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9433ca9-0f02-4d14-a6cd-48994c410679 already deleted. [ 761.830011] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9433ca9-0f02-4d14-a6cd-48994c410679" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.012523] env[69789]: INFO networking_nsxv3.common.synchronization [None req-e982157b-b7ef-4d06-8fe1-7d9ae9c5e6ed tempest-AttachInterfacesUnderV243Test-1689768257 tempest-AttachInterfacesUnderV243Test-1689768257-project-member] Enqueued Resource ID: 0f162aff-651a-45b1-a733-9670ba60f113 with Priority: HIGHEST for action security_group_rules [ 762.013265] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f162aff-651a-45b1-a733-9670ba60f113 with Priority: HIGHEST for action security_group_rules [ 762.013389] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f162aff-651a-45b1-a733-9670ba60f113 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.013472] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f162aff-651a-45b1-a733-9670ba60f113" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.013524] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f162aff-651a-45b1-a733-9670ba60f113" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.013770] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f162aff-651a-45b1-a733-9670ba60f113" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.013853] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f162aff-651a-45b1-a733-9670ba60f113',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.141476] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.141629] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.141702] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.141915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.142010] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.142111] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32582c2f-c1cd-408e-b1a9-980d2191f90d already deleted. [ 762.142193] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32582c2f-c1cd-408e-b1a9-980d2191f90d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.379988] env[69789]: INFO networking_nsxv3.common.synchronization [None req-cb2367cd-db34-49b9-b780-65902a874ae0 tempest-AttachInterfacesUnderV243Test-1689768257 tempest-AttachInterfacesUnderV243Test-1689768257-project-member] Enqueued Resource ID: 0f162aff-651a-45b1-a733-9670ba60f113 with Priority: HIGHEST for action security_group_rules [ 762.379988] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f162aff-651a-45b1-a733-9670ba60f113 with Priority: HIGHEST for action security_group_rules [ 762.379988] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f162aff-651a-45b1-a733-9670ba60f113 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.379988] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f162aff-651a-45b1-a733-9670ba60f113" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.544663] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.544663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.544663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.544663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.544663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.544663] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f162aff-651a-45b1-a733-9670ba60f113 already deleted. [ 762.544663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f162aff-651a-45b1-a733-9670ba60f113" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.544663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f162aff-651a-45b1-a733-9670ba60f113" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.544663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f162aff-651a-45b1-a733-9670ba60f113" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.544663] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f162aff-651a-45b1-a733-9670ba60f113',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.658718] env[69789]: INFO networking_nsxv3.common.synchronization [req-7df59935-5b10-462f-abf8-713668cc501c req-ce184fc1-8e81-44de-8def-9a7ecfdca9b4 tempest-ServersWithSpecificFlavorTestJSON-738434098 tempest-ServersWithSpecificFlavorTestJSON-738434098-project-member] Enqueued Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_members [ 762.663014] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_members [ 762.663014] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.663014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.663014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.663014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.663014] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.663014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.663014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.663014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.663014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.663014] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.896968] env[69789]: INFO networking_nsxv3.common.synchronization [req-b770e4ed-c2e7-4902-bccd-6ace6a8617a1 req-2d9a162c-b746-412a-bc3a-7f6b59342760 service nova] Enqueued Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_rules [ 762.896968] env[69789]: INFO networking_nsxv3.common.synchronization [req-b770e4ed-c2e7-4902-bccd-6ace6a8617a1 req-2d9a162c-b746-412a-bc3a-7f6b59342760 service nova] Enqueued Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_members [ 762.896968] env[69789]: INFO networking_nsxv3.common.synchronization [req-b770e4ed-c2e7-4902-bccd-6ace6a8617a1 req-2d9a162c-b746-412a-bc3a-7f6b59342760 service nova] Enqueued Resource ID: 3c9189a9-01dd-42e1-b2b3-9d0f3f53448e with Priority: HIGHEST for action port [ 762.897392] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_rules [ 762.897392] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_members [ 762.897679] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c9189a9-01dd-42e1-b2b3-9d0f3f53448e with Priority: HIGHEST for action port [ 762.898031] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-367b3953-c384-4a92-8d77-5aeea593412d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.899340] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.899340] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.899546] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.899608] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.900609] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-367b3953-c384-4a92-8d77-5aeea593412d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.900742] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.902620] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.902620] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.902620] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.902620] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.902895] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.902895] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.903184] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.903184] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.904065] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.904195] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.904315] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.905258] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.905258] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c9189a9-01dd-42e1-b2b3-9d0f3f53448e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.072609] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.072609] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.072609] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.072609] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.072609] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.072609] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f162aff-651a-45b1-a733-9670ba60f113 already deleted. [ 763.072609] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f162aff-651a-45b1-a733-9670ba60f113" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.168337] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.168337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.168337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.168337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.168337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.168337] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.168337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.168337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.168337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.168337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.168337] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 already deleted. [ 763.168337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.406728] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-367b3953-c384-4a92-8d77-5aeea593412d taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.406728] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.411764] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.411764] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c9189a9-01dd-42e1-b2b3-9d0f3f53448e with status ACTIVE [ 763.411764] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.411764] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.411764] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.411764] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.412728] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.412728] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c9189a9-01dd-42e1-b2b3-9d0f3f53448e is going to be updated. [ 763.435293] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.435293] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.435293] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.435293] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.435293] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.435293] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c9189a9-01dd-42e1-b2b3-9d0f3f53448e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.914761] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.419138] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.419305] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.419376] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.419599] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.419692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.419792] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 367b3953-c384-4a92-8d77-5aeea593412d is going to be created. [ 764.451239] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.451239] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.451239] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.451239] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.451239] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.460394] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 367b3953-c384-4a92-8d77-5aeea593412d in Status: UNINITIALIZED for 2s [ 764.520764] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.520764] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-94" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.520764] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-94" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.520764] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-94" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.520764] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.520764] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.520764] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.522249] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.522249] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.522249] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.522249] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.522249] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.522502] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.522502] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.522573] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.522705] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.547862] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.552042] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 764.552042] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.552042] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-94" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.558977] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.558977] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.558977] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.559379] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.559582] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e84f8d87-5538-4cfd-ac81-c58c1b4fca74',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.574193] env[69789]: INFO networking_nsxv3.common.synchronization [None req-46e29b85-e9d6-4859-9f5c-3acb53533ad5 None None] Enqueued Resource ID: 4b17df53-4875-41d0-8841-a77ea88d1788 with Priority: HIGHEST for action port [ 764.575080] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b17df53-4875-41d0-8841-a77ea88d1788 with Priority: HIGHEST for action port [ 764.577272] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b17df53-4875-41d0-8841-a77ea88d1788 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.577272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b17df53-4875-41d0-8841-a77ea88d1788" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.577272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b17df53-4875-41d0-8841-a77ea88d1788" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.577272] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b17df53-4875-41d0-8841-a77ea88d1788" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.577272] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b17df53-4875-41d0-8841-a77ea88d1788',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.067099] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.067441] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.067507] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.067790] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.067992] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.068192] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port e84f8d87-5538-4cfd-ac81-c58c1b4fca74 not found, creating... [ 765.068464] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.068621] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.068749] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.069465] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.069465] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.070795] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.071085] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.071243] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.071760] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.071900] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.072065] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: e84f8d87-5538-4cfd-ac81-c58c1b4fca74 is going to be created. [ 765.078788] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b17df53-4875-41d0-8841-a77ea88d1788 [ 765.079428] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.079609] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.079681] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.079894] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.079986] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.080717] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b17df53-4875-41d0-8841-a77ea88d1788 already deleted. [ 765.080717] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b17df53-4875-41d0-8841-a77ea88d1788" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.093283] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.094017] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.094017] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.094017] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.094157] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.094596] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.168765] env[69789]: INFO networking_nsxv3.common.synchronization [None req-e50e6784-e282-4ba8-aebf-b0e7ef42da24 None None] Enqueued Resource ID: 86161d3a-c74f-4cc6-96ba-46bd244c9a66 with Priority: HIGHEST for action port [ 765.169097] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86161d3a-c74f-4cc6-96ba-46bd244c9a66 with Priority: HIGHEST for action port [ 765.170624] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-86161d3a-c74f-4cc6-96ba-46bd244c9a66 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.170624] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86161d3a-c74f-4cc6-96ba-46bd244c9a66" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.170624] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86161d3a-c74f-4cc6-96ba-46bd244c9a66" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.170624] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86161d3a-c74f-4cc6-96ba-46bd244c9a66" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.170624] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86161d3a-c74f-4cc6-96ba-46bd244c9a66',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.674069] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86161d3a-c74f-4cc6-96ba-46bd244c9a66 [ 765.674069] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.674069] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.674069] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.674069] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.674325] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.674595] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86161d3a-c74f-4cc6-96ba-46bd244c9a66 already deleted. [ 765.674595] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86161d3a-c74f-4cc6-96ba-46bd244c9a66" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.475954] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 367b3953-c384-4a92-8d77-5aeea593412d in Status: SUCCESS [ 766.476215] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.476366] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.476583] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.476778] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.477068] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.477068] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.477185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.477185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.477274] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.477398] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.665047] env[69789]: INFO networking_nsxv3.common.synchronization [req-7df59935-5b10-462f-abf8-713668cc501c req-9064142d-0749-49cd-a30b-6ff3e526e47f service nova] Enqueued Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_rules [ 766.665281] env[69789]: INFO networking_nsxv3.common.synchronization [req-7df59935-5b10-462f-abf8-713668cc501c req-9064142d-0749-49cd-a30b-6ff3e526e47f service nova] Enqueued Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_members [ 766.665415] env[69789]: INFO networking_nsxv3.common.synchronization [req-7df59935-5b10-462f-abf8-713668cc501c req-9064142d-0749-49cd-a30b-6ff3e526e47f service nova] Enqueued Resource ID: e84f8d87-5538-4cfd-ac81-c58c1b4fca74 with Priority: HIGHEST for action port [ 766.666961] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_rules [ 766.666961] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_members [ 766.666961] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84f8d87-5538-4cfd-ac81-c58c1b4fca74 with Priority: HIGHEST for action port [ 766.666961] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.666961] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.666961] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.666961] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.667417] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.668359] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.668474] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.668543] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.668720] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.668860] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.668952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.669024] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.669169] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.669256] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.669381] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.673157] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.675436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.675436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.675436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.675436] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e84f8d87-5538-4cfd-ac81-c58c1b4fca74',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.980361] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.162037] env[69789]: INFO networking_nsxv3.common.synchronization [req-a5ddd6ff-091e-4a0c-891b-191511849874 req-065b739b-7798-442e-8d29-be755063b64a tempest-ServerAddressesNegativeTestJSON-668879773 tempest-ServerAddressesNegativeTestJSON-668879773-project-member] Enqueued Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGHEST for action security_group_members [ 767.162794] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGHEST for action security_group_members [ 767.164293] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79f91b1-6637-404d-83b8-9a172d2bbf3b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.164601] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.164866] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.164974] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.165182] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.165341] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.165392] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.165589] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.165702] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.165810] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.175204] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.177110] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.177264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.183461] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e84f8d87-5538-4cfd-ac81-c58c1b4fca74 with status ACTIVE [ 767.183618] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.183818] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.183818] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.184069] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.184168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.184374] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.184510] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.184596] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.184739] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.184814] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.185691] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.185691] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.185691] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.185691] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.185691] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.186102] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e84f8d87-5538-4cfd-ac81-c58c1b4fca74 is going to be updated. [ 767.215883] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.216113] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.216211] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.216461] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.216653] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.216915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e84f8d87-5538-4cfd-ac81-c58c1b4fca74" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.483018] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 367b3953-c384-4a92-8d77-5aeea593412d: rpc.has_security_group_logging(os_id): False [ 767.507976] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.508151] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.508227] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.508446] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.508529] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.508992] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.508992] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.508992] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.509233] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.509288] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.509432] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 367b3953-c384-4a92-8d77-5aeea593412d is going to be created. [ 767.575630] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.575939] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.575939] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.576166] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.576549] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.594249] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 367b3953-c384-4a92-8d77-5aeea593412d in Status: IN_PROGRESS for 2s [ 767.675171] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.675171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.675171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.675171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.675171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.675171] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.675171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.675171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.675171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.675171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.675171] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b already deleted. [ 767.675171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.675171] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.060190] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-598 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.061515] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-598" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.061963] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-598" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.062327] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-598" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.063911] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.064195] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.064354] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.064653] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.064805] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.065067] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.065183] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.065353] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.065510] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.065699] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.065889] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.066124] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.091352] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.091786] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.092109] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.092250] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-598" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.092639] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-1e57c340-c4d4-45c7-977f-167e94856c47 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.092888] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-1e57c340-c4d4-45c7-977f-167e94856c47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.094292] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-1e57c340-c4d4-45c7-977f-167e94856c47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.094786] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-1e57c340-c4d4-45c7-977f-167e94856c47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.096021] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e57c340-c4d4-45c7-977f-167e94856c47',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.181419] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.181568] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.181651] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.181885] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.181980] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.182098] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 is going to be created. [ 768.220305] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.220459] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.220532] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.220744] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.221500] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.232561] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 in Status: UNINITIALIZED for 2s [ 768.509157] env[69789]: INFO networking_nsxv3.common.synchronization [None req-f37fd576-b4fe-4d11-b0f9-d2e2c09e6c0c None None] Enqueued Resource ID: 894f3a18-0b31-4f3f-97d4-8c0ae4340b12 with Priority: HIGHEST for action port [ 768.509157] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 894f3a18-0b31-4f3f-97d4-8c0ae4340b12 with Priority: HIGHEST for action port [ 768.509157] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-894f3a18-0b31-4f3f-97d4-8c0ae4340b12 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.509157] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-894f3a18-0b31-4f3f-97d4-8c0ae4340b12" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.513586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-894f3a18-0b31-4f3f-97d4-8c0ae4340b12" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.513832] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-894f3a18-0b31-4f3f-97d4-8c0ae4340b12" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.513924] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('894f3a18-0b31-4f3f-97d4-8c0ae4340b12',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.599208] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.600151] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.600151] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.600151] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.600151] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.600605] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 1e57c340-c4d4-45c7-977f-167e94856c47 not found, creating... [ 768.600605] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.600715] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.604168] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.604168] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.604168] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.604168] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.604601] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.604601] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.605109] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.605109] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.605109] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 1e57c340-c4d4-45c7-977f-167e94856c47 is going to be created. [ 768.628553] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.629192] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.629407] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.629694] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.629940] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.630328] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-1e57c340-c4d4-45c7-977f-167e94856c47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.860204] env[69789]: INFO networking_nsxv3.common.synchronization [None req-3bc12c66-9451-4940-bb17-e5f5365686e5 None None] Enqueued Resource ID: bc540847-4093-45ff-a5e9-9202b21d1ddd with Priority: HIGHEST for action port [ 768.860204] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc540847-4093-45ff-a5e9-9202b21d1ddd with Priority: HIGHEST for action port [ 768.860204] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc540847-4093-45ff-a5e9-9202b21d1ddd taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.860204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc540847-4093-45ff-a5e9-9202b21d1ddd" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.860204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc540847-4093-45ff-a5e9-9202b21d1ddd" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.860204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc540847-4093-45ff-a5e9-9202b21d1ddd" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.860204] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc540847-4093-45ff-a5e9-9202b21d1ddd',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.965887] env[69789]: INFO networking_nsxv3.common.synchronization [req-06c8a32f-607f-4cae-8db7-086b18da9e13 req-326a3656-ca64-4212-aeaf-8c61fe74f3ed tempest-ServersAdminTestJSON-67121385 tempest-ServersAdminTestJSON-67121385-project-member] Enqueued Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGHEST for action security_group_members [ 768.966109] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGHEST for action security_group_members [ 768.966683] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.967718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.967770] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.968153] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.968339] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.968339] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.968475] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.968573] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.968663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.968763] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.018020] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 894f3a18-0b31-4f3f-97d4-8c0ae4340b12 [ 769.018231] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.018413] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.018490] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.018962] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.019087] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.019259] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:894f3a18-0b31-4f3f-97d4-8c0ae4340b12 already deleted. [ 769.019300] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-894f3a18-0b31-4f3f-97d4-8c0ae4340b12" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.188064] env[69789]: INFO networking_nsxv3.common.synchronization [req-a510478c-ae1e-4f67-bec1-42de05d27486 req-07b882fc-7961-4546-8842-e9bea5a42a6a tempest-TenantUsagesTestJSON-1751090999 tempest-TenantUsagesTestJSON-1751090999-project-member] Enqueued Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGHEST for action security_group_members [ 769.188659] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGHEST for action security_group_members [ 769.191179] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a60025-1a74-47a6-8a27-9b49e8f20582 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.191179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.191179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.191179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.191179] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.191179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.191179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.191179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.191179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.191179] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.367712] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc540847-4093-45ff-a5e9-9202b21d1ddd [ 769.367890] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.368216] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.368216] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.368336] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.368605] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.368605] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc540847-4093-45ff-a5e9-9202b21d1ddd already deleted. [ 769.368674] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc540847-4093-45ff-a5e9-9202b21d1ddd" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.473064] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.473450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.473450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.473725] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.473879] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.474142] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.475345] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.475345] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.475345] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.475345] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.475345] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d already deleted. [ 769.475345] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.604104] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 367b3953-c384-4a92-8d77-5aeea593412d in Status: SUCCESS [ 769.604343] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.693981] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.694308] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.694308] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.694501] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.694585] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.694790] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.694889] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.694955] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.695317] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.695317] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.695317] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 is going to be updated. [ 769.726600] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.726600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.726600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.726600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.726600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.734723] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 in Status: IN_PROGRESS for 2s [ 770.245958] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 in Status: SUCCESS [ 770.245958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.245958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.245958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.245958] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.245958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.245958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.245958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.245958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.245958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.245958] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.277943] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.277943] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-502" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.277943] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-502" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.279869] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-502" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.279869] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.280504] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.280504] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.280914] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.281014] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.281393] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.282716] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.282716] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.282914] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.283062] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.283355] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.283597] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.288966] env[69789]: INFO networking_nsxv3.common.synchronization [req-a5ddd6ff-091e-4a0c-891b-191511849874 req-1d3a3630-9fc0-4460-94b6-97ca1bfb9e02 service nova] Enqueued Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGHEST for action security_group_rules [ 770.288966] env[69789]: INFO networking_nsxv3.common.synchronization [req-a5ddd6ff-091e-4a0c-891b-191511849874 req-1d3a3630-9fc0-4460-94b6-97ca1bfb9e02 service nova] Enqueued Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGHEST for action security_group_members [ 770.288966] env[69789]: INFO networking_nsxv3.common.synchronization [req-a5ddd6ff-091e-4a0c-891b-191511849874 req-1d3a3630-9fc0-4460-94b6-97ca1bfb9e02 service nova] Enqueued Resource ID: 1e57c340-c4d4-45c7-977f-167e94856c47 with Priority: HIGHEST for action port [ 770.290160] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGHEST for action security_group_rules [ 770.292020] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGHEST for action security_group_members [ 770.292020] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e57c340-c4d4-45c7-977f-167e94856c47 with Priority: HIGHEST for action port [ 770.292020] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.292020] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.292494] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.292494] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.292614] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.295039] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79f91b1-6637-404d-83b8-9a172d2bbf3b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.295221] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.295909] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.299822] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.299822] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.299822] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.299822] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.299822] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.299822] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.299822] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.299822] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e57c340-c4d4-45c7-977f-167e94856c47 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.300338] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e57c340-c4d4-45c7-977f-167e94856c47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.300594] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e57c340-c4d4-45c7-977f-167e94856c47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.300927] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e57c340-c4d4-45c7-977f-167e94856c47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.301091] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e57c340-c4d4-45c7-977f-167e94856c47',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.314874] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.315154] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.315420] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.315736] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-502" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.316539] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-55aaf1a4-955a-4984-a881-c49328cd474c taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.317297] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-55aaf1a4-955a-4984-a881-c49328cd474c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.317297] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-55aaf1a4-955a-4984-a881-c49328cd474c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.318813] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-55aaf1a4-955a-4984-a881-c49328cd474c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.318813] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55aaf1a4-955a-4984-a881-c49328cd474c',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.363042] env[69789]: INFO networking_nsxv3.common.synchronization [None req-e70d3718-afc5-402e-9c79-6feaafc3398b None None] Enqueued Resource ID: 3bd7f413-03c9-4cbf-be16-bf73978fb6e5 with Priority: HIGHEST for action port [ 770.363664] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd7f413-03c9-4cbf-be16-bf73978fb6e5 with Priority: HIGHEST for action port [ 770.363962] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bd7f413-03c9-4cbf-be16-bf73978fb6e5 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.364195] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bd7f413-03c9-4cbf-be16-bf73978fb6e5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.364195] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bd7f413-03c9-4cbf-be16-bf73978fb6e5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.364413] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bd7f413-03c9-4cbf-be16-bf73978fb6e5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.364981] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bd7f413-03c9-4cbf-be16-bf73978fb6e5',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.749639] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.803213] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79f91b1-6637-404d-83b8-9a172d2bbf3b taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.803350] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.803551] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.804589] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e57c340-c4d4-45c7-977f-167e94856c47 with status ACTIVE [ 770.804649] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.804738] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.804801] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.804997] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.805100] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.805268] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.805361] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.805420] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.805601] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.805676] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.805846] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.806858] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.806858] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.806858] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.806858] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.806858] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e57c340-c4d4-45c7-977f-167e94856c47 is going to be updated. [ 770.826146] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.826146] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.826146] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.827403] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.827788] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.828882] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 55aaf1a4-955a-4984-a881-c49328cd474c not found, creating... [ 770.829398] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.829398] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.830348] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.830693] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.831266] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.831449] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.831839] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.832010] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.833222] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.833222] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.833222] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 55aaf1a4-955a-4984-a881-c49328cd474c is going to be created. [ 770.834797] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.834979] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.835105] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.835310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.835509] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.835730] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e57c340-c4d4-45c7-977f-167e94856c47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.857359] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.857749] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.858039] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.858462] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.859038] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.859411] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-55aaf1a4-955a-4984-a881-c49328cd474c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.866642] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3bd7f413-03c9-4cbf-be16-bf73978fb6e5 [ 770.867701] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.867865] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.867947] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.868203] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.868298] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.868395] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3bd7f413-03c9-4cbf-be16-bf73978fb6e5 already deleted. [ 770.868478] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bd7f413-03c9-4cbf-be16-bf73978fb6e5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.230233] env[69789]: INFO networking_nsxv3.common.synchronization [None req-f62f82a5-3c41-4533-851d-b41eeffb6920 None None] Enqueued Resource ID: 8883484e-0cef-400f-af85-bacdb21d1db1 with Priority: HIGHEST for action port [ 771.230442] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8883484e-0cef-400f-af85-bacdb21d1db1 with Priority: HIGHEST for action port [ 771.231394] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-8883484e-0cef-400f-af85-bacdb21d1db1 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.231394] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8883484e-0cef-400f-af85-bacdb21d1db1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.231394] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8883484e-0cef-400f-af85-bacdb21d1db1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.231661] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8883484e-0cef-400f-af85-bacdb21d1db1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.234247] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8883484e-0cef-400f-af85-bacdb21d1db1',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.253012] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebe3ec3b-ff53-4ea3-bf1f-5938fc203196: rpc.has_security_group_logging(os_id): False [ 771.274218] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.274218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.274218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.274218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.274218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.274218] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.274218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.274218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.274218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.274218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.274218] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 is going to be created. [ 771.308726] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.354754] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.354949] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.355029] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.355254] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.355495] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.373227] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 in Status: IN_PROGRESS for 2s [ 771.738922] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8883484e-0cef-400f-af85-bacdb21d1db1 [ 771.738922] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.739168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.739168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.739369] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.739460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.739557] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8883484e-0cef-400f-af85-bacdb21d1db1 already deleted. [ 771.739639] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8883484e-0cef-400f-af85-bacdb21d1db1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.748871] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 in Status: SUCCESS [ 771.752279] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 deletion is rescheduled due to dependency. [ 771.752279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.812442] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.813468] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.813468] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.813468] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.813468] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.813468] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b is going to be created. [ 771.843185] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.843185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.843185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.843185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.843185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.855937] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b in Status: UNINITIALIZED for 2s [ 772.547247] env[69789]: INFO networking_nsxv3.common.synchronization [None req-00e66ae7-84ea-498e-90d6-4b8e5caf350f tempest-AttachInterfacesTestJSON-527541319 tempest-AttachInterfacesTestJSON-527541319-project-member] Enqueued Resource ID: d16f57c9-da09-450f-b653-39b52a9737bb with Priority: HIGHEST for action security_group_rules [ 772.547498] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16f57c9-da09-450f-b653-39b52a9737bb with Priority: HIGHEST for action security_group_rules [ 772.547832] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d16f57c9-da09-450f-b653-39b52a9737bb taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.547957] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d16f57c9-da09-450f-b653-39b52a9737bb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.550516] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d16f57c9-da09-450f-b653-39b52a9737bb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.550689] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d16f57c9-da09-450f-b653-39b52a9737bb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.550793] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d16f57c9-da09-450f-b653-39b52a9737bb',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.686820] env[69789]: INFO networking_nsxv3.common.synchronization [req-06c8a32f-607f-4cae-8db7-086b18da9e13 req-57dce08d-d94b-4c93-a2dd-70aaeb6b7c38 service nova] Enqueued Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGHEST for action security_group_rules [ 772.687006] env[69789]: INFO networking_nsxv3.common.synchronization [req-06c8a32f-607f-4cae-8db7-086b18da9e13 req-57dce08d-d94b-4c93-a2dd-70aaeb6b7c38 service nova] Enqueued Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGHEST for action security_group_members [ 772.687146] env[69789]: INFO networking_nsxv3.common.synchronization [req-06c8a32f-607f-4cae-8db7-086b18da9e13 req-57dce08d-d94b-4c93-a2dd-70aaeb6b7c38 service nova] Enqueued Resource ID: 55aaf1a4-955a-4984-a881-c49328cd474c with Priority: HIGHEST for action port [ 772.687613] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGHEST for action security_group_rules [ 772.687748] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGHEST for action security_group_members [ 772.687845] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55aaf1a4-955a-4984-a881-c49328cd474c with Priority: HIGHEST for action port [ 772.692779] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.692779] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.692779] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.696016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.696016] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.696016] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.696016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.696016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.699306] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.699306] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.699306] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.699306] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.699306] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.699306] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.699306] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.699306] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-55aaf1a4-955a-4984-a881-c49328cd474c taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.699306] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55aaf1a4-955a-4984-a881-c49328cd474c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.699692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55aaf1a4-955a-4984-a881-c49328cd474c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.699692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55aaf1a4-955a-4984-a881-c49328cd474c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.699692] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55aaf1a4-955a-4984-a881-c49328cd474c',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.902102] env[69789]: INFO networking_nsxv3.common.synchronization [None req-58d13f3d-db59-4f47-838a-c32755cc436a tempest-AttachInterfacesTestJSON-527541319 tempest-AttachInterfacesTestJSON-527541319-project-member] Enqueued Resource ID: d16f57c9-da09-450f-b653-39b52a9737bb with Priority: HIGHEST for action security_group_rules [ 772.902430] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16f57c9-da09-450f-b653-39b52a9737bb with Priority: HIGHEST for action security_group_rules [ 772.904013] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d16f57c9-da09-450f-b653-39b52a9737bb taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.904013] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d16f57c9-da09-450f-b653-39b52a9737bb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.931846] env[69789]: INFO networking_nsxv3.common.synchronization [None req-54941e46-5d0d-4d4a-b67d-27b1de3d0dd8 None None] Enqueued Resource ID: fc2d26ec-e94f-4f81-8eb1-84f360d28305 with Priority: HIGHEST for action port [ 772.932069] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc2d26ec-e94f-4f81-8eb1-84f360d28305 with Priority: HIGHEST for action port [ 772.932368] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc2d26ec-e94f-4f81-8eb1-84f360d28305 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.932531] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc2d26ec-e94f-4f81-8eb1-84f360d28305" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.932604] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc2d26ec-e94f-4f81-8eb1-84f360d28305" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.932863] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc2d26ec-e94f-4f81-8eb1-84f360d28305" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.932942] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc2d26ec-e94f-4f81-8eb1-84f360d28305',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.075168] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.075168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.075168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.075168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.075355] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.075387] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d16f57c9-da09-450f-b653-39b52a9737bb already deleted. [ 773.076540] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d16f57c9-da09-450f-b653-39b52a9737bb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.076540] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d16f57c9-da09-450f-b653-39b52a9737bb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.076540] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d16f57c9-da09-450f-b653-39b52a9737bb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.076540] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d16f57c9-da09-450f-b653-39b52a9737bb',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.205032] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.205032] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.205032] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.205032] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55aaf1a4-955a-4984-a881-c49328cd474c with status ACTIVE [ 773.205032] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.205032] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.205032] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.205032] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.205032] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.206573] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.206936] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.207214] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.207589] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.208289] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.210200] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.210200] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.210200] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.210200] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.210200] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.210200] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55aaf1a4-955a-4984-a881-c49328cd474c is going to be updated. [ 773.233432] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.233599] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.234569] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.235694] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.235748] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.235915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55aaf1a4-955a-4984-a881-c49328cd474c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.325109] env[69789]: INFO networking_nsxv3.common.synchronization [None req-37d8bb0e-fe8c-4144-b5ea-30a296ac209d None None] Enqueued Resource ID: e0934f39-cf83-4239-aadc-06e8a68c5279 with Priority: HIGHEST for action port [ 773.325467] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0934f39-cf83-4239-aadc-06e8a68c5279 with Priority: HIGHEST for action port [ 773.327259] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0934f39-cf83-4239-aadc-06e8a68c5279 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.327493] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0934f39-cf83-4239-aadc-06e8a68c5279" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.327939] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0934f39-cf83-4239-aadc-06e8a68c5279" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.327939] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0934f39-cf83-4239-aadc-06e8a68c5279" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.328816] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0934f39-cf83-4239-aadc-06e8a68c5279',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.396284] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 in Status: SUCCESS [ 773.396513] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.440074] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc2d26ec-e94f-4f81-8eb1-84f360d28305 [ 773.440074] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.440074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.440074] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.440268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.440299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.441857] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc2d26ec-e94f-4f81-8eb1-84f360d28305 already deleted. [ 773.442510] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc2d26ec-e94f-4f81-8eb1-84f360d28305" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.598116] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.598287] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.598383] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.598844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.598942] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.599092] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d16f57c9-da09-450f-b653-39b52a9737bb already deleted. [ 773.599192] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d16f57c9-da09-450f-b653-39b52a9737bb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.713279] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.831366] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0934f39-cf83-4239-aadc-06e8a68c5279 [ 773.832390] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.832390] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.832390] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.832390] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.832390] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.832390] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0934f39-cf83-4239-aadc-06e8a68c5279 already deleted. [ 773.832390] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0934f39-cf83-4239-aadc-06e8a68c5279" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.874506] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b in Status: SUCCESS [ 773.874807] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.875681] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.875955] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.876297] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.876450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.876532] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.876710] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.878132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.878265] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.878387] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.220187] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.220608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.220608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.220845] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.220845] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.220845] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d is going to be created. [ 774.248486] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.248631] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.248707] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.249271] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.249271] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.266399] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d in Status: UNINITIALIZED for 2s [ 774.381298] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79f91b1-6637-404d-83b8-9a172d2bbf3b taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.381900] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.381900] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.381900] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.383256] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.383325] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.383420] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.383874] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.383874] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.383874] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.384040] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79f91b1-6637-404d-83b8-9a172d2bbf3b taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.384571] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.384571] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.384571] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.384571] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.384774] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.384774] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.384986] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.385087] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.385229] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.385724] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.890366] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a79f91b1-6637-404d-83b8-9a172d2bbf3b: rpc.has_security_group_logging(os_id): False [ 774.915802] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.916024] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.916120] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.916383] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.917264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.917264] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.917264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.917264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.917264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.917264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.917569] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.917569] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.917647] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.917795] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.918140] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.918140] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.918290] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.918472] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.918514] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.919440] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.919440] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b is going to be created. [ 774.987094] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.987263] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.987331] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.987612] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.989107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.001907] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b in Status: IN_PROGRESS for 2s [ 776.276971] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d in Status: SUCCESS [ 776.277321] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.277398] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.277733] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.277843] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.278085] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.278129] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.278258] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.278338] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.278421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.278515] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.659909] env[69789]: INFO networking_nsxv3.common.synchronization [None req-c13eb311-94e3-46ff-9ee2-20516023cdb9 None None] Enqueued Resource ID: 9de982d1-8eb3-43a6-a728-822e3c36244e with Priority: HIGHEST for action port [ 776.660181] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de982d1-8eb3-43a6-a728-822e3c36244e with Priority: HIGHEST for action port [ 776.661471] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-9de982d1-8eb3-43a6-a728-822e3c36244e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.661471] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9de982d1-8eb3-43a6-a728-822e3c36244e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.661471] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9de982d1-8eb3-43a6-a728-822e3c36244e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.661471] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9de982d1-8eb3-43a6-a728-822e3c36244e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.661471] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9de982d1-8eb3-43a6-a728-822e3c36244e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.782090] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.782460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.782460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.782683] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.784425] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.784425] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.784425] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.784425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.784425] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.018296] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b in Status: SUCCESS [ 777.018296] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.164032] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9de982d1-8eb3-43a6-a728-822e3c36244e [ 777.164032] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.164032] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.164032] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.164433] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.164433] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.164520] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9de982d1-8eb3-43a6-a728-822e3c36244e already deleted. [ 777.165494] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9de982d1-8eb3-43a6-a728-822e3c36244e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.289427] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be9ea5aa-5019-4bd3-86c8-7647a3bc317d: rpc.has_security_group_logging(os_id): False [ 777.314022] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.314022] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.314022] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.314022] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.314797] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.314797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.314797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.315341] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.317321] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.317321] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d is going to be created. [ 777.384222] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.386498] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.386498] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.386498] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.386498] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.403413] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d in Status: IN_PROGRESS for 2s [ 778.335914] env[69789]: INFO networking_nsxv3.common.synchronization [None req-576dcdcf-095b-43d5-b4a4-7053d281892e None None] Enqueued Resource ID: 31b48085-c216-4a60-8067-303e3c09a925 with Priority: HIGHEST for action port [ 778.337392] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b48085-c216-4a60-8067-303e3c09a925 with Priority: HIGHEST for action port [ 778.338403] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-31b48085-c216-4a60-8067-303e3c09a925 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.338546] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31b48085-c216-4a60-8067-303e3c09a925" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.338606] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31b48085-c216-4a60-8067-303e3c09a925" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.338967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31b48085-c216-4a60-8067-303e3c09a925" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.339071] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b48085-c216-4a60-8067-303e3c09a925',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.841611] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31b48085-c216-4a60-8067-303e3c09a925 [ 778.841836] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.841967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.842058] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.842310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.842353] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.842431] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31b48085-c216-4a60-8067-303e3c09a925 already deleted. [ 778.842503] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31b48085-c216-4a60-8067-303e3c09a925" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.417351] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d in Status: SUCCESS [ 779.417351] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.180252] env[69789]: INFO networking_nsxv3.common.synchronization [None req-59ef0e66-b799-4727-87f0-2f8b5384877c None None] Enqueued Resource ID: 2e56ca38-97ea-48c7-8afe-d7461063c540 with Priority: HIGHEST for action port [ 781.180252] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e56ca38-97ea-48c7-8afe-d7461063c540 with Priority: HIGHEST for action port [ 781.181156] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e56ca38-97ea-48c7-8afe-d7461063c540 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.181451] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e56ca38-97ea-48c7-8afe-d7461063c540" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.182989] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e56ca38-97ea-48c7-8afe-d7461063c540" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.182989] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e56ca38-97ea-48c7-8afe-d7461063c540" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.182989] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e56ca38-97ea-48c7-8afe-d7461063c540',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.393631] env[69789]: INFO networking_nsxv3.common.synchronization [None req-da4decc7-3971-4829-8d4e-632f487056fb None None] Enqueued Resource ID: 50159e82-fe82-49bb-b1fd-078e4c3d9c08 with Priority: HIGHEST for action port [ 781.393900] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50159e82-fe82-49bb-b1fd-078e4c3d9c08 with Priority: HIGHEST for action port [ 781.394481] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-50159e82-fe82-49bb-b1fd-078e4c3d9c08 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.394639] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50159e82-fe82-49bb-b1fd-078e4c3d9c08" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.394763] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50159e82-fe82-49bb-b1fd-078e4c3d9c08" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.395095] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50159e82-fe82-49bb-b1fd-078e4c3d9c08" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.396316] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50159e82-fe82-49bb-b1fd-078e4c3d9c08',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.685273] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e56ca38-97ea-48c7-8afe-d7461063c540 [ 781.685273] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.685273] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.685273] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.685273] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.685273] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.685273] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e56ca38-97ea-48c7-8afe-d7461063c540 already deleted. [ 781.685273] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e56ca38-97ea-48c7-8afe-d7461063c540" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.899505] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50159e82-fe82-49bb-b1fd-078e4c3d9c08 [ 781.899793] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.899969] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.900050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.900311] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.900415] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.900555] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50159e82-fe82-49bb-b1fd-078e4c3d9c08 already deleted. [ 781.900692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50159e82-fe82-49bb-b1fd-078e4c3d9c08" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.802125] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a32dca83-f8f1-4487-8e43-cc28b199dbb1 tempest-ServerActionsTestJSON-2097779956 tempest-ServerActionsTestJSON-2097779956-project-member] Enqueued Resource ID: 1f0e2e09-6caa-4716-b213-5af43eacdf91 with Priority: HIGHEST for action security_group_rules [ 782.802125] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e2e09-6caa-4716-b213-5af43eacdf91 with Priority: HIGHEST for action security_group_rules [ 782.802125] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f0e2e09-6caa-4716-b213-5af43eacdf91 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.805581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f0e2e09-6caa-4716-b213-5af43eacdf91" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.805581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f0e2e09-6caa-4716-b213-5af43eacdf91" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.805581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f0e2e09-6caa-4716-b213-5af43eacdf91" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.805581] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f0e2e09-6caa-4716-b213-5af43eacdf91',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.180950] env[69789]: INFO networking_nsxv3.common.synchronization [None req-8932b1da-03c4-4fce-ad3b-f4ec8b4387ce tempest-ServerActionsTestJSON-2097779956 tempest-ServerActionsTestJSON-2097779956-project-member] Enqueued Resource ID: 1f0e2e09-6caa-4716-b213-5af43eacdf91 with Priority: HIGHEST for action security_group_rules [ 783.180950] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e2e09-6caa-4716-b213-5af43eacdf91 with Priority: HIGHEST for action security_group_rules [ 783.180950] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f0e2e09-6caa-4716-b213-5af43eacdf91 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.182295] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f0e2e09-6caa-4716-b213-5af43eacdf91" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.332611] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.332762] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.332821] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.333051] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.333175] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.333244] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f0e2e09-6caa-4716-b213-5af43eacdf91 already deleted. [ 783.333324] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f0e2e09-6caa-4716-b213-5af43eacdf91" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.333487] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f0e2e09-6caa-4716-b213-5af43eacdf91" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.333636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f0e2e09-6caa-4716-b213-5af43eacdf91" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.334400] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f0e2e09-6caa-4716-b213-5af43eacdf91',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.454193] env[69789]: INFO networking_nsxv3.common.synchronization [None req-c59c344e-eff7-4e38-934d-98eeb5e1b03d None None] Enqueued Resource ID: b131891b-e4f9-4558-96be-3799a07f980b with Priority: HIGHEST for action port [ 783.454531] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b131891b-e4f9-4558-96be-3799a07f980b with Priority: HIGHEST for action port [ 783.455201] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-b131891b-e4f9-4558-96be-3799a07f980b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.455337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b131891b-e4f9-4558-96be-3799a07f980b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.455404] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b131891b-e4f9-4558-96be-3799a07f980b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.455684] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b131891b-e4f9-4558-96be-3799a07f980b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.455936] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b131891b-e4f9-4558-96be-3799a07f980b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.875250] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.875250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.875250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.875250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.875250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.875250] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f0e2e09-6caa-4716-b213-5af43eacdf91 already deleted. [ 783.876118] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f0e2e09-6caa-4716-b213-5af43eacdf91" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.959137] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b131891b-e4f9-4558-96be-3799a07f980b [ 783.960031] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.960031] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.960031] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.960031] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.960031] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.960031] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b131891b-e4f9-4558-96be-3799a07f980b already deleted. [ 783.960503] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b131891b-e4f9-4558-96be-3799a07f980b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.617895] env[69789]: INFO networking_nsxv3.common.synchronization [None req-bfa88a33-fac0-4f0c-afdc-fb5a244433c8 None None] Enqueued Resource ID: f2f1d233-ba49-4e34-a96f-c8651038a716 with Priority: HIGHEST for action port [ 784.619099] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f1d233-ba49-4e34-a96f-c8651038a716 with Priority: HIGHEST for action port [ 784.619099] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2f1d233-ba49-4e34-a96f-c8651038a716 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.619099] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2f1d233-ba49-4e34-a96f-c8651038a716" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.619099] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2f1d233-ba49-4e34-a96f-c8651038a716" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.621117] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2f1d233-ba49-4e34-a96f-c8651038a716" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.621117] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f1d233-ba49-4e34-a96f-c8651038a716',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.122780] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2f1d233-ba49-4e34-a96f-c8651038a716 [ 785.123077] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.123163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.123229] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.123653] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.123653] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.123653] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2f1d233-ba49-4e34-a96f-c8651038a716 already deleted. [ 785.123792] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2f1d233-ba49-4e34-a96f-c8651038a716" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.585267] env[69789]: INFO networking_nsxv3.common.synchronization [req-2309303b-458d-4c5b-95ae-006e28afbf91 req-a5b31231-2090-453f-8b53-70ae07985728 tempest-ServersAdminTestJSON-67121385 tempest-ServersAdminTestJSON-67121385-project-member] Enqueued Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGHEST for action security_group_members [ 785.586490] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGHEST for action security_group_members [ 785.586490] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.586490] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.586490] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.586490] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.586845] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.586845] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.588876] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.589108] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.589276] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.589398] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.939012] env[69789]: INFO networking_nsxv3.common.synchronization [req-6f776a54-b38b-4339-b105-db70f2488ca0 req-0ce5bc62-c636-4346-9ee0-65d27dae634c tempest-ServerAddressesNegativeTestJSON-668879773 tempest-ServerAddressesNegativeTestJSON-668879773-project-member] Enqueued Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGHEST for action security_group_members [ 785.939515] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGHEST for action security_group_members [ 785.940456] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79f91b1-6637-404d-83b8-9a172d2bbf3b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.940570] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.940570] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.940883] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.941444] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.941444] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.941444] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.942770] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.942770] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.942770] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.092559] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.092712] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.092784] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.093045] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.093126] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.093310] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.093425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.093483] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.093602] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.093868] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.093868] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d is going to be updated. [ 786.126097] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.126097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.126097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.126097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.126097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.134735] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d in Status: IN_PROGRESS for 2s [ 786.445166] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.445370] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.445429] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.445644] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.446851] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.447149] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.447267] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.449859] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.449859] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.449859] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.449859] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b is going to be updated. [ 786.476913] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.476913] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.476913] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.476913] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.476913] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.487218] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b in Status: IN_PROGRESS for 2s [ 786.996845] env[69789]: INFO networking_nsxv3.common.synchronization [None req-03f1f087-c247-4691-8aab-57d9f2379978 None None] Enqueued Resource ID: 8ddfc755-c76a-4c4a-a729-468cba1480aa with Priority: HIGHEST for action port [ 786.997492] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ddfc755-c76a-4c4a-a729-468cba1480aa with Priority: HIGHEST for action port [ 786.997704] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ddfc755-c76a-4c4a-a729-468cba1480aa taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.997853] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ddfc755-c76a-4c4a-a729-468cba1480aa" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.997924] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ddfc755-c76a-4c4a-a729-468cba1480aa" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.999920] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ddfc755-c76a-4c4a-a729-468cba1480aa" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.000199] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ddfc755-c76a-4c4a-a729-468cba1480aa',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.314443] env[69789]: INFO networking_nsxv3.common.synchronization [None req-6cecfdf8-e20b-4587-adea-f71de79706ef None None] Enqueued Resource ID: 6b909b04-c770-456a-98ba-51c506cb2b16 with Priority: HIGHEST for action port [ 787.314443] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b909b04-c770-456a-98ba-51c506cb2b16 with Priority: HIGHEST for action port [ 787.314443] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b909b04-c770-456a-98ba-51c506cb2b16 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.314443] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b909b04-c770-456a-98ba-51c506cb2b16" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.314443] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b909b04-c770-456a-98ba-51c506cb2b16" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.314443] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b909b04-c770-456a-98ba-51c506cb2b16" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.314443] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b909b04-c770-456a-98ba-51c506cb2b16',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.501952] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ddfc755-c76a-4c4a-a729-468cba1480aa [ 787.502211] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.502367] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.502409] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.502628] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.502848] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.502892] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ddfc755-c76a-4c4a-a729-468cba1480aa already deleted. [ 787.502978] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ddfc755-c76a-4c4a-a729-468cba1480aa" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.664323] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b909b04-c770-456a-98ba-51c506cb2b16 [ 787.664562] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.665363] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.665363] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.665363] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.665363] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.665363] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b909b04-c770-456a-98ba-51c506cb2b16 already deleted. [ 787.665363] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b909b04-c770-456a-98ba-51c506cb2b16" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.147013] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d in Status: SUCCESS [ 788.147207] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d deletion is rescheduled due to dependency. [ 788.147332] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.421601] env[69789]: INFO networking_nsxv3.common.synchronization [None req-2733f79a-f709-499c-a76d-f0e8a73ffe2e None None] Enqueued Resource ID: 914be9d3-16cb-4862-b514-21a611927afc with Priority: HIGHEST for action port [ 788.422424] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914be9d3-16cb-4862-b514-21a611927afc with Priority: HIGHEST for action port [ 788.422787] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-914be9d3-16cb-4862-b514-21a611927afc taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.422918] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-914be9d3-16cb-4862-b514-21a611927afc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.423025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-914be9d3-16cb-4862-b514-21a611927afc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.423294] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-914be9d3-16cb-4862-b514-21a611927afc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.423403] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914be9d3-16cb-4862-b514-21a611927afc',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.496316] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b in Status: SUCCESS [ 788.497133] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b deletion is rescheduled due to dependency. [ 788.497133] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.926109] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 914be9d3-16cb-4862-b514-21a611927afc [ 788.926420] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.926627] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.926930] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.926987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.927100] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.927204] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:914be9d3-16cb-4862-b514-21a611927afc already deleted. [ 788.927374] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-914be9d3-16cb-4862-b514-21a611927afc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.051580] env[69789]: INFO networking_nsxv3.common.synchronization [None req-e0cb2a44-64e8-4725-a15e-1bdffd594553 None None] Enqueued Resource ID: 83680cf8-aa4f-43c7-983d-9409cc4727f1 with Priority: HIGHEST for action port [ 789.051914] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83680cf8-aa4f-43c7-983d-9409cc4727f1 with Priority: HIGHEST for action port [ 789.052631] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-83680cf8-aa4f-43c7-983d-9409cc4727f1 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.052833] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83680cf8-aa4f-43c7-983d-9409cc4727f1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.052888] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83680cf8-aa4f-43c7-983d-9409cc4727f1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.053124] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83680cf8-aa4f-43c7-983d-9409cc4727f1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.053236] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83680cf8-aa4f-43c7-983d-9409cc4727f1',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.347344] env[69789]: INFO networking_nsxv3.common.synchronization [None req-2d865e2e-0c4f-4804-bf6f-4aeb08df0440 None None] Enqueued Resource ID: 065e4919-e966-480d-b885-cfd40bb74e21 with Priority: HIGHEST for action port [ 789.347445] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065e4919-e966-480d-b885-cfd40bb74e21 with Priority: HIGHEST for action port [ 789.348064] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-065e4919-e966-480d-b885-cfd40bb74e21 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.348212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-065e4919-e966-480d-b885-cfd40bb74e21" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.348212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-065e4919-e966-480d-b885-cfd40bb74e21" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.352019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-065e4919-e966-480d-b885-cfd40bb74e21" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.352019] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('065e4919-e966-480d-b885-cfd40bb74e21',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.558547] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83680cf8-aa4f-43c7-983d-9409cc4727f1 [ 789.559136] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.560234] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.560234] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.560234] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.560234] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.560234] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83680cf8-aa4f-43c7-983d-9409cc4727f1 already deleted. [ 789.560234] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83680cf8-aa4f-43c7-983d-9409cc4727f1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.858909] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 065e4919-e966-480d-b885-cfd40bb74e21 [ 789.859259] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.859356] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.859393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.859586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.859670] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.859761] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:065e4919-e966-480d-b885-cfd40bb74e21 already deleted. [ 789.859837] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-065e4919-e966-480d-b885-cfd40bb74e21" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.206100] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a88d1a8c-c1bc-4a3f-a64f-dfdeb7acb65f tempest-ServerActionsV293TestJSON-1380610808 tempest-ServerActionsV293TestJSON-1380610808-project-member] Enqueued Resource ID: 64c3e969-936e-4d65-95ac-027d9ce65294 with Priority: HIGHEST for action security_group_rules [ 790.206967] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c3e969-936e-4d65-95ac-027d9ce65294 with Priority: HIGHEST for action security_group_rules [ 790.211427] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64c3e969-936e-4d65-95ac-027d9ce65294 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.211427] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64c3e969-936e-4d65-95ac-027d9ce65294" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.211427] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64c3e969-936e-4d65-95ac-027d9ce65294" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.211427] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64c3e969-936e-4d65-95ac-027d9ce65294" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.211427] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64c3e969-936e-4d65-95ac-027d9ce65294',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.406373] env[69789]: INFO networking_nsxv3.common.synchronization [None req-c16d82eb-54dc-47e2-aa42-dc4cc2ffde88 tempest-ServerActionsV293TestJSON-1380610808 tempest-ServerActionsV293TestJSON-1380610808-project-member] Enqueued Resource ID: 64c3e969-936e-4d65-95ac-027d9ce65294 with Priority: HIGHEST for action security_group_rules [ 790.407676] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c3e969-936e-4d65-95ac-027d9ce65294 with Priority: HIGHEST for action security_group_rules [ 790.408024] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64c3e969-936e-4d65-95ac-027d9ce65294 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.408114] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64c3e969-936e-4d65-95ac-027d9ce65294" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.734802] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.734802] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.734802] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.734802] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.735294] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.735294] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64c3e969-936e-4d65-95ac-027d9ce65294 already deleted. [ 790.735294] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64c3e969-936e-4d65-95ac-027d9ce65294" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.736291] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64c3e969-936e-4d65-95ac-027d9ce65294" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.736291] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64c3e969-936e-4d65-95ac-027d9ce65294" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.736291] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64c3e969-936e-4d65-95ac-027d9ce65294',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.259028] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.259028] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.259028] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.259028] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.259028] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.259028] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64c3e969-936e-4d65-95ac-027d9ce65294 already deleted. [ 791.259028] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64c3e969-936e-4d65-95ac-027d9ce65294" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.430478] env[69789]: INFO networking_nsxv3.common.synchronization [None req-1425eee9-3151-4c88-85c7-add5a1623e53 tempest-ServersTestBootFromVolume-1386714627 tempest-ServersTestBootFromVolume-1386714627-project-member] Enqueued Resource ID: 6c1959b3-4742-4978-9a23-1eaf9cd481c8 with Priority: HIGHEST for action security_group_rules [ 791.430478] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c1959b3-4742-4978-9a23-1eaf9cd481c8 with Priority: HIGHEST for action security_group_rules [ 791.430834] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.430915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.430958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.431562] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.431562] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c1959b3-4742-4978-9a23-1eaf9cd481c8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.746611] env[69789]: INFO networking_nsxv3.common.synchronization [None req-2cd4bec4-c369-4ab0-a2e0-7ccac68e3db4 tempest-ServersTestBootFromVolume-1386714627 tempest-ServersTestBootFromVolume-1386714627-project-member] Enqueued Resource ID: 6c1959b3-4742-4978-9a23-1eaf9cd481c8 with Priority: HIGHEST for action security_group_rules [ 791.747180] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c1959b3-4742-4978-9a23-1eaf9cd481c8 with Priority: HIGHEST for action security_group_rules [ 791.747480] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.747581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.953765] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.953873] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.953980] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.955017] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.955017] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.958258] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c1959b3-4742-4978-9a23-1eaf9cd481c8 already deleted. [ 791.958425] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.958680] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.958952] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.959087] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c1959b3-4742-4978-9a23-1eaf9cd481c8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.085624] env[69789]: INFO networking_nsxv3.common.synchronization [None req-2f234f9c-f4de-4edd-9397-1978a0903e06 None None] Enqueued Resource ID: 3e1e84c3-2538-4022-8afd-1087fbcc2ab1 with Priority: HIGHEST for action port [ 792.085624] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e1e84c3-2538-4022-8afd-1087fbcc2ab1 with Priority: HIGHEST for action port [ 792.085624] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e1e84c3-2538-4022-8afd-1087fbcc2ab1 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.085624] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e1e84c3-2538-4022-8afd-1087fbcc2ab1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.085624] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e1e84c3-2538-4022-8afd-1087fbcc2ab1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.085624] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e1e84c3-2538-4022-8afd-1087fbcc2ab1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.085624] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1e84c3-2538-4022-8afd-1087fbcc2ab1',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.099914] env[69789]: INFO networking_nsxv3.common.synchronization [None req-76ff5e71-0253-497c-86b0-ba6efdff3174 None None] Enqueued Resource ID: 7bcbfbd9-069a-4a81-804c-c78290e1d97b with Priority: HIGHEST for action port [ 792.100177] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcbfbd9-069a-4a81-804c-c78290e1d97b with Priority: HIGHEST for action port [ 792.100728] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bcbfbd9-069a-4a81-804c-c78290e1d97b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.100857] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bcbfbd9-069a-4a81-804c-c78290e1d97b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.100921] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bcbfbd9-069a-4a81-804c-c78290e1d97b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.101193] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bcbfbd9-069a-4a81-804c-c78290e1d97b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.101293] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bcbfbd9-069a-4a81-804c-c78290e1d97b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.482769] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.482926] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.482984] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.483228] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.483321] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.483416] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c1959b3-4742-4978-9a23-1eaf9cd481c8 already deleted. [ 792.483499] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c1959b3-4742-4978-9a23-1eaf9cd481c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.589974] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e1e84c3-2538-4022-8afd-1087fbcc2ab1 [ 792.590241] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.590368] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.590439] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.590673] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.590771] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.590892] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e1e84c3-2538-4022-8afd-1087fbcc2ab1 already deleted. [ 792.590979] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e1e84c3-2538-4022-8afd-1087fbcc2ab1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.608664] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bcbfbd9-069a-4a81-804c-c78290e1d97b [ 792.608926] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.609108] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.609164] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.609355] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.609437] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.609527] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bcbfbd9-069a-4a81-804c-c78290e1d97b already deleted. [ 792.609603] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bcbfbd9-069a-4a81-804c-c78290e1d97b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.143984] env[69789]: INFO networking_nsxv3.common.synchronization [None req-439926f0-39fd-4dc6-a271-8bb9e030bacd None None] Enqueued Resource ID: ad41e176-3cea-434e-914b-5290d8d7c094 with Priority: HIGHEST for action port [ 796.143984] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad41e176-3cea-434e-914b-5290d8d7c094 with Priority: HIGHEST for action port [ 796.143984] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad41e176-3cea-434e-914b-5290d8d7c094 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.143984] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad41e176-3cea-434e-914b-5290d8d7c094" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.143984] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad41e176-3cea-434e-914b-5290d8d7c094" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.143984] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad41e176-3cea-434e-914b-5290d8d7c094" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.145074] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad41e176-3cea-434e-914b-5290d8d7c094',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.150701] env[69789]: INFO networking_nsxv3.common.synchronization [req-a0c86707-c072-44b6-8545-89ab30bed3c7 req-689ee471-1c56-43d1-83fc-7f33364b9b88 tempest-ServersAdminNegativeTestJSON-280202454 tempest-ServersAdminNegativeTestJSON-280202454-project-member] Enqueued Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGHEST for action security_group_members [ 796.151643] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGHEST for action security_group_members [ 796.157138] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b546181-293b-47af-ad81-70b5a00fd2e3 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.157138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.157138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.157138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.157138] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.157362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.157362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.157652] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.157652] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.157759] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.648436] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad41e176-3cea-434e-914b-5290d8d7c094 [ 796.648664] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.648816] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.648885] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.649132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.649221] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.649315] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad41e176-3cea-434e-914b-5290d8d7c094 already deleted. [ 796.649393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad41e176-3cea-434e-914b-5290d8d7c094" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.663636] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.663636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.663636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.663636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.664158] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.664158] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.664158] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.664158] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.664399] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.664399] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.664399] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 is going to be updated. [ 796.708210] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.709320] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.709320] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.709320] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.709320] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.726874] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 in Status: IN_PROGRESS for 2s [ 798.374230] env[69789]: INFO networking_nsxv3.common.synchronization [None req-b5569786-e620-4b03-ac13-93d06b929f3d None None] Enqueued Resource ID: 6641d222-19bb-4cac-9fdf-e42e2073ea56 with Priority: HIGHEST for action port [ 798.374230] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6641d222-19bb-4cac-9fdf-e42e2073ea56 with Priority: HIGHEST for action port [ 798.374230] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-6641d222-19bb-4cac-9fdf-e42e2073ea56 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.376278] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6641d222-19bb-4cac-9fdf-e42e2073ea56" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.376278] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6641d222-19bb-4cac-9fdf-e42e2073ea56" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.378585] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6641d222-19bb-4cac-9fdf-e42e2073ea56" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.378585] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6641d222-19bb-4cac-9fdf-e42e2073ea56',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.466655] env[69789]: INFO networking_nsxv3.common.synchronization [None req-99e13dee-6519-4fda-ba04-4d1ee51f3845 None None] Enqueued Resource ID: 956cfa83-3f96-4613-9bb3-2f82b01a039f with Priority: HIGHEST for action port [ 798.467400] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 956cfa83-3f96-4613-9bb3-2f82b01a039f with Priority: HIGHEST for action port [ 798.467649] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-956cfa83-3f96-4613-9bb3-2f82b01a039f taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.467782] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-956cfa83-3f96-4613-9bb3-2f82b01a039f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.467882] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-956cfa83-3f96-4613-9bb3-2f82b01a039f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.468915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-956cfa83-3f96-4613-9bb3-2f82b01a039f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.468915] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('956cfa83-3f96-4613-9bb3-2f82b01a039f',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.741929] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 in Status: SUCCESS [ 798.741929] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 deletion is rescheduled due to dependency. [ 798.741929] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.879207] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6641d222-19bb-4cac-9fdf-e42e2073ea56 [ 798.881655] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.881655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.881655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.881655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.881655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.881655] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6641d222-19bb-4cac-9fdf-e42e2073ea56 already deleted. [ 798.881655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6641d222-19bb-4cac-9fdf-e42e2073ea56" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.974447] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 956cfa83-3f96-4613-9bb3-2f82b01a039f [ 798.974447] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.974447] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.974447] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.974861] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.974861] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.974861] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:956cfa83-3f96-4613-9bb3-2f82b01a039f already deleted. [ 798.974978] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-956cfa83-3f96-4613-9bb3-2f82b01a039f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.631342] env[69789]: INFO networking_nsxv3.common.synchronization [None req-2f1f045a-025e-4dee-a067-1099e3134227 None None] Enqueued Resource ID: b374bfdb-1231-4985-abdb-87a74a4c5eda with Priority: HIGHEST for action port [ 800.632082] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b374bfdb-1231-4985-abdb-87a74a4c5eda with Priority: HIGHEST for action port [ 800.632440] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-b374bfdb-1231-4985-abdb-87a74a4c5eda taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.632649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b374bfdb-1231-4985-abdb-87a74a4c5eda" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.632805] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b374bfdb-1231-4985-abdb-87a74a4c5eda" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.633355] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b374bfdb-1231-4985-abdb-87a74a4c5eda" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.633532] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b374bfdb-1231-4985-abdb-87a74a4c5eda',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.925663] env[69789]: INFO networking_nsxv3.common.synchronization [None req-22fd1507-d363-4518-b257-9b0ab2d51320 None None] Enqueued Resource ID: 2d2f4d77-2364-4499-a4ae-17dc88c9cc1b with Priority: HIGHEST for action port [ 800.929667] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d2f4d77-2364-4499-a4ae-17dc88c9cc1b with Priority: HIGHEST for action port [ 800.929667] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d2f4d77-2364-4499-a4ae-17dc88c9cc1b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.929667] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d2f4d77-2364-4499-a4ae-17dc88c9cc1b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.929667] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d2f4d77-2364-4499-a4ae-17dc88c9cc1b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.929667] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d2f4d77-2364-4499-a4ae-17dc88c9cc1b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.929667] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d2f4d77-2364-4499-a4ae-17dc88c9cc1b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.136517] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b374bfdb-1231-4985-abdb-87a74a4c5eda [ 801.136759] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.136891] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.136958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.137250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.137340] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.137438] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b374bfdb-1231-4985-abdb-87a74a4c5eda already deleted. [ 801.137517] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b374bfdb-1231-4985-abdb-87a74a4c5eda" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.431700] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d2f4d77-2364-4499-a4ae-17dc88c9cc1b [ 801.431700] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.431700] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.431914] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.431957] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.432181] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.432181] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d2f4d77-2364-4499-a4ae-17dc88c9cc1b already deleted. [ 801.432268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d2f4d77-2364-4499-a4ae-17dc88c9cc1b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.225785] env[69789]: INFO networking_nsxv3.common.synchronization [None req-3638b3e6-63c7-42f9-a01e-e5b34dd7726e tempest-ServerActionsTestOtherB-883203743 tempest-ServerActionsTestOtherB-883203743-project-member] Enqueued Resource ID: 2e737228-6a88-44e8-bc64-55bdc0b59e6a with Priority: HIGHEST for action security_group_rules [ 802.225785] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e737228-6a88-44e8-bc64-55bdc0b59e6a with Priority: HIGHEST for action security_group_rules [ 802.225785] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.225785] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.225785] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.225785] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.225785] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e737228-6a88-44e8-bc64-55bdc0b59e6a',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.319908] env[69789]: INFO networking_nsxv3.common.synchronization [None req-6a808e1f-dcf3-4b55-83fc-6e545ee82ced tempest-ServerActionsTestOtherB-883203743 tempest-ServerActionsTestOtherB-883203743-project-member] Enqueued Resource ID: 2e737228-6a88-44e8-bc64-55bdc0b59e6a with Priority: HIGHEST for action security_group_rules [ 802.320437] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e737228-6a88-44e8-bc64-55bdc0b59e6a with Priority: HIGHEST for action security_group_rules [ 802.320726] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.320833] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.751416] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.751557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.751626] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.751829] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.751912] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.752012] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e737228-6a88-44e8-bc64-55bdc0b59e6a already deleted. [ 802.752097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.752243] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.752389] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.752467] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e737228-6a88-44e8-bc64-55bdc0b59e6a',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.198874] env[69789]: INFO networking_nsxv3.common.synchronization [None req-6ec99ed5-bdf0-40b2-95f6-628b7ed8afc1 None None] Enqueued Resource ID: 6acb1455-9b3b-40d8-9c5c-4e32bcdf028a with Priority: HIGHEST for action port [ 803.199156] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6acb1455-9b3b-40d8-9c5c-4e32bcdf028a with Priority: HIGHEST for action port [ 803.199907] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-6acb1455-9b3b-40d8-9c5c-4e32bcdf028a taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.199907] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6acb1455-9b3b-40d8-9c5c-4e32bcdf028a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.200246] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6acb1455-9b3b-40d8-9c5c-4e32bcdf028a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.202348] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6acb1455-9b3b-40d8-9c5c-4e32bcdf028a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.202348] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6acb1455-9b3b-40d8-9c5c-4e32bcdf028a',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.282950] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.283310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.283310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.283391] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.283489] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.283587] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e737228-6a88-44e8-bc64-55bdc0b59e6a already deleted. [ 803.283675] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e737228-6a88-44e8-bc64-55bdc0b59e6a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.709165] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6acb1455-9b3b-40d8-9c5c-4e32bcdf028a [ 803.709165] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.709165] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.709165] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.709165] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.709165] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.709165] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6acb1455-9b3b-40d8-9c5c-4e32bcdf028a already deleted. [ 803.709165] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6acb1455-9b3b-40d8-9c5c-4e32bcdf028a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.800150] env[69789]: INFO networking_nsxv3.common.synchronization [None req-ab6736e5-4206-4184-8bc8-1064c083ee76 None None] Enqueued Resource ID: 6a4314a1-813c-4556-857a-069e8d98f51e with Priority: HIGHEST for action port [ 803.800150] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a4314a1-813c-4556-857a-069e8d98f51e with Priority: HIGHEST for action port [ 803.800573] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a4314a1-813c-4556-857a-069e8d98f51e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.800708] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a4314a1-813c-4556-857a-069e8d98f51e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.800776] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a4314a1-813c-4556-857a-069e8d98f51e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.802070] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a4314a1-813c-4556-857a-069e8d98f51e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.802194] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4314a1-813c-4556-857a-069e8d98f51e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.304593] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a4314a1-813c-4556-857a-069e8d98f51e [ 804.304843] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.304843] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.304843] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.305084] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.305183] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.305287] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a4314a1-813c-4556-857a-069e8d98f51e already deleted. [ 804.305371] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a4314a1-813c-4556-857a-069e8d98f51e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.490742] env[69789]: INFO networking_nsxv3.common.synchronization [None req-8a52f2d7-255d-4b0c-881d-905cfe2990de tempest-ServersV294TestFqdnHostnames-581560284 tempest-ServersV294TestFqdnHostnames-581560284-project-member] Enqueued Resource ID: d7201bd9-3696-40f2-afff-4e58d3ff575c with Priority: HIGHEST for action security_group_rules [ 804.494021] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7201bd9-3696-40f2-afff-4e58d3ff575c with Priority: HIGHEST for action security_group_rules [ 804.494021] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7201bd9-3696-40f2-afff-4e58d3ff575c taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.494021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7201bd9-3696-40f2-afff-4e58d3ff575c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.494021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7201bd9-3696-40f2-afff-4e58d3ff575c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.494021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7201bd9-3696-40f2-afff-4e58d3ff575c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.494021] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7201bd9-3696-40f2-afff-4e58d3ff575c',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.655256] env[69789]: INFO networking_nsxv3.common.synchronization [None req-d34fed88-d741-44fe-ad40-67d779fd16bd tempest-ServersV294TestFqdnHostnames-581560284 tempest-ServersV294TestFqdnHostnames-581560284-project-member] Enqueued Resource ID: d7201bd9-3696-40f2-afff-4e58d3ff575c with Priority: HIGHEST for action security_group_rules [ 804.656745] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7201bd9-3696-40f2-afff-4e58d3ff575c with Priority: HIGHEST for action security_group_rules [ 804.656745] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7201bd9-3696-40f2-afff-4e58d3ff575c taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.656745] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7201bd9-3696-40f2-afff-4e58d3ff575c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.014495] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.014599] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.014667] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.014929] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.015107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.015157] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7201bd9-3696-40f2-afff-4e58d3ff575c already deleted. [ 805.015212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7201bd9-3696-40f2-afff-4e58d3ff575c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.015349] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7201bd9-3696-40f2-afff-4e58d3ff575c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.015517] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7201bd9-3696-40f2-afff-4e58d3ff575c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.015595] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7201bd9-3696-40f2-afff-4e58d3ff575c',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.324328] env[69789]: INFO networking_nsxv3.common.synchronization [None req-f7a17d20-d68a-4f1a-a781-71575ee31def None None] Enqueued Resource ID: 023fac02-a92d-4990-a58a-fb975cd55a5e with Priority: HIGHEST for action port [ 805.324328] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023fac02-a92d-4990-a58a-fb975cd55a5e with Priority: HIGHEST for action port [ 805.325202] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-023fac02-a92d-4990-a58a-fb975cd55a5e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.326803] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-023fac02-a92d-4990-a58a-fb975cd55a5e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.326803] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-023fac02-a92d-4990-a58a-fb975cd55a5e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.330490] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-023fac02-a92d-4990-a58a-fb975cd55a5e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.330604] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('023fac02-a92d-4990-a58a-fb975cd55a5e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.542930] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.543091] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.543147] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.543362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.543445] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.543546] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7201bd9-3696-40f2-afff-4e58d3ff575c already deleted. [ 805.543631] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7201bd9-3696-40f2-afff-4e58d3ff575c" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.838935] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 023fac02-a92d-4990-a58a-fb975cd55a5e [ 805.838935] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.838935] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.838935] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.838935] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.838935] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.838935] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:023fac02-a92d-4990-a58a-fb975cd55a5e already deleted. [ 805.838935] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-023fac02-a92d-4990-a58a-fb975cd55a5e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.326026] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 810.326026] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 812.506673] env[69789]: INFO networking_nsxv3.common.synchronization [None req-b8ae5259-295d-4a19-a4a3-0e336a19f68a None None] Enqueued Resource ID: 72959e54-fe73-4cfd-98e8-92141b3c46aa with Priority: HIGHEST for action port [ 812.506673] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72959e54-fe73-4cfd-98e8-92141b3c46aa with Priority: HIGHEST for action port [ 812.507036] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-72959e54-fe73-4cfd-98e8-92141b3c46aa taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.507036] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72959e54-fe73-4cfd-98e8-92141b3c46aa" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.507036] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72959e54-fe73-4cfd-98e8-92141b3c46aa" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.507358] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72959e54-fe73-4cfd-98e8-92141b3c46aa" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.507444] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72959e54-fe73-4cfd-98e8-92141b3c46aa',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.013169] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72959e54-fe73-4cfd-98e8-92141b3c46aa [ 813.013169] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.013389] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.013389] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.013486] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.013571] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.013662] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72959e54-fe73-4cfd-98e8-92141b3c46aa already deleted. [ 813.013739] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72959e54-fe73-4cfd-98e8-92141b3c46aa" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.344336] env[69789]: INFO networking_nsxv3.common.synchronization [None req-0ee1b0b0-4555-4f86-a70b-de51ef8c0c44 tempest-AttachInterfacesTestJSON-527541319 tempest-AttachInterfacesTestJSON-527541319-project-member] Enqueued Resource ID: ac400108-1333-4d80-b6a4-a0dfe658295e with Priority: HIGHEST for action security_group_rules [ 813.344968] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac400108-1333-4d80-b6a4-a0dfe658295e with Priority: HIGHEST for action security_group_rules [ 813.347430] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac400108-1333-4d80-b6a4-a0dfe658295e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.347430] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac400108-1333-4d80-b6a4-a0dfe658295e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.347430] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac400108-1333-4d80-b6a4-a0dfe658295e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.347430] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac400108-1333-4d80-b6a4-a0dfe658295e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.347430] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac400108-1333-4d80-b6a4-a0dfe658295e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.428698] env[69789]: INFO networking_nsxv3.common.synchronization [None req-446d11c3-d397-4f9b-a059-7251c8a39f6a tempest-AttachInterfacesTestJSON-527541319 tempest-AttachInterfacesTestJSON-527541319-project-member] Enqueued Resource ID: ac400108-1333-4d80-b6a4-a0dfe658295e with Priority: HIGHEST for action security_group_rules [ 813.430017] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac400108-1333-4d80-b6a4-a0dfe658295e with Priority: HIGHEST for action security_group_rules [ 813.431400] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac400108-1333-4d80-b6a4-a0dfe658295e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.431400] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac400108-1333-4d80-b6a4-a0dfe658295e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.874747] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.875147] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.875147] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.876632] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.876889] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.876889] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac400108-1333-4d80-b6a4-a0dfe658295e already deleted. [ 813.876967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac400108-1333-4d80-b6a4-a0dfe658295e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.877108] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac400108-1333-4d80-b6a4-a0dfe658295e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.877279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac400108-1333-4d80-b6a4-a0dfe658295e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.877369] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac400108-1333-4d80-b6a4-a0dfe658295e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.404112] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.404112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.404112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.404112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.404112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.404112] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac400108-1333-4d80-b6a4-a0dfe658295e already deleted. [ 814.404112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac400108-1333-4d80-b6a4-a0dfe658295e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.623204] env[69789]: INFO networking_nsxv3.common.synchronization [None req-f89a8dbc-25c4-47ac-972d-e9c9f2e1bf1f None None] Enqueued Resource ID: 46682b0c-4d77-443a-8d68-cece2bb8be49 with Priority: HIGHEST for action port [ 814.623419] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46682b0c-4d77-443a-8d68-cece2bb8be49 with Priority: HIGHEST for action port [ 814.623776] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-46682b0c-4d77-443a-8d68-cece2bb8be49 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.624359] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46682b0c-4d77-443a-8d68-cece2bb8be49" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.624359] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46682b0c-4d77-443a-8d68-cece2bb8be49" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.624359] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46682b0c-4d77-443a-8d68-cece2bb8be49" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.624359] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46682b0c-4d77-443a-8d68-cece2bb8be49',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.130301] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46682b0c-4d77-443a-8d68-cece2bb8be49 [ 815.130648] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.130648] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.130744] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.130925] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.131027] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.131160] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46682b0c-4d77-443a-8d68-cece2bb8be49 already deleted. [ 815.131212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46682b0c-4d77-443a-8d68-cece2bb8be49" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.364656] env[69789]: INFO networking_nsxv3.common.synchronization [req-b06e3c02-7d6e-404f-a908-9658c5890eee req-9b84c889-df61-4232-8a85-96ea0357015d tempest-ServersTestJSON-542552314 tempest-ServersTestJSON-542552314-project-member] Enqueued Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_members [ 815.365377] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGHEST for action security_group_members [ 815.365562] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.366046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.366046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.366470] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.366671] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.366776] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.366839] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.367014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.367113] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.367217] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.869331] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.869500] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.869573] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.869802] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.869898] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.870103] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.870210] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.870273] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.870426] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.870503] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.870587] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e is going to be updated. [ 815.903010] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.903010] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.903010] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.903010] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.903010] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.909600] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e in Status: IN_PROGRESS for 2s [ 817.922424] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e in Status: SUCCESS [ 817.922677] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e deletion is rescheduled due to dependency. [ 817.922721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.282770] env[69789]: INFO networking_nsxv3.common.synchronization [None req-39a3d12c-6729-4271-95ec-d30f14eb431b None None] Enqueued Resource ID: 68465e06-caa4-4af1-beca-7f7b8e6c0604 with Priority: HIGHEST for action port [ 819.283773] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68465e06-caa4-4af1-beca-7f7b8e6c0604 with Priority: HIGHEST for action port [ 819.284291] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-68465e06-caa4-4af1-beca-7f7b8e6c0604 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.284542] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68465e06-caa4-4af1-beca-7f7b8e6c0604" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.284689] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68465e06-caa4-4af1-beca-7f7b8e6c0604" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.285071] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68465e06-caa4-4af1-beca-7f7b8e6c0604" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.285253] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68465e06-caa4-4af1-beca-7f7b8e6c0604',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.792787] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68465e06-caa4-4af1-beca-7f7b8e6c0604 [ 819.792787] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.792787] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.792787] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.792787] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.792787] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.792787] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68465e06-caa4-4af1-beca-7f7b8e6c0604 already deleted. [ 819.792787] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68465e06-caa4-4af1-beca-7f7b8e6c0604" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.896210] env[69789]: INFO networking_nsxv3.common.synchronization [None req-bb4d7ae9-0c6b-4830-ae9e-6cadfe2ec161 None None] Enqueued Resource ID: ce9d4095-a50c-4c66-be75-ffd57ac9c5e3 with Priority: HIGHEST for action port [ 820.896210] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9d4095-a50c-4c66-be75-ffd57ac9c5e3 with Priority: HIGHEST for action port [ 820.896210] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce9d4095-a50c-4c66-be75-ffd57ac9c5e3 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.896210] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce9d4095-a50c-4c66-be75-ffd57ac9c5e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.896210] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce9d4095-a50c-4c66-be75-ffd57ac9c5e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.896210] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce9d4095-a50c-4c66-be75-ffd57ac9c5e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.896210] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce9d4095-a50c-4c66-be75-ffd57ac9c5e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.399059] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce9d4095-a50c-4c66-be75-ffd57ac9c5e3 [ 821.399059] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.399059] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.399059] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.399059] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.399370] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.399370] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce9d4095-a50c-4c66-be75-ffd57ac9c5e3 already deleted. [ 821.399370] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce9d4095-a50c-4c66-be75-ffd57ac9c5e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.540787] env[69789]: INFO networking_nsxv3.common.synchronization [None req-08e1af8f-545e-49dd-adb0-1e0f0be34e92 None None] Enqueued Resource ID: 8f1cc306-c567-4486-bc72-f8491ed237c1 with Priority: HIGHEST for action port [ 821.541033] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1cc306-c567-4486-bc72-f8491ed237c1 with Priority: HIGHEST for action port [ 821.541563] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f1cc306-c567-4486-bc72-f8491ed237c1 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.541687] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f1cc306-c567-4486-bc72-f8491ed237c1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.541752] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f1cc306-c567-4486-bc72-f8491ed237c1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.543825] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f1cc306-c567-4486-bc72-f8491ed237c1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.543983] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f1cc306-c567-4486-bc72-f8491ed237c1',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.912268] env[69789]: INFO networking_nsxv3.common.synchronization [None req-8701c69f-922c-4389-8efb-bad21846cdbf tempest-ServerActionsTestOtherA-1361495306 tempest-ServerActionsTestOtherA-1361495306-project-member] Enqueued Resource ID: bf2c4153-8d36-459c-80b4-7a1d6df88c9d with Priority: HIGHEST for action security_group_rules [ 821.912268] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf2c4153-8d36-459c-80b4-7a1d6df88c9d with Priority: HIGHEST for action security_group_rules [ 821.912268] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.912268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.912268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.912268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.912268] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf2c4153-8d36-459c-80b4-7a1d6df88c9d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.046063] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f1cc306-c567-4486-bc72-f8491ed237c1 [ 822.046274] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.046405] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.046574] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.046716] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.046791] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.046887] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f1cc306-c567-4486-bc72-f8491ed237c1 already deleted. [ 822.046968] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f1cc306-c567-4486-bc72-f8491ed237c1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.047865] env[69789]: INFO networking_nsxv3.common.synchronization [None req-5cdc5c8d-e3ec-4489-a649-20dc07ff135f tempest-ServerActionsTestOtherA-1361495306 tempest-ServerActionsTestOtherA-1361495306-project-member] Enqueued Resource ID: bf2c4153-8d36-459c-80b4-7a1d6df88c9d with Priority: HIGHEST for action security_group_rules [ 822.048394] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf2c4153-8d36-459c-80b4-7a1d6df88c9d with Priority: HIGHEST for action security_group_rules [ 822.048676] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.048791] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.435896] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.435896] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.435896] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.435896] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.436069] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.436100] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf2c4153-8d36-459c-80b4-7a1d6df88c9d already deleted. [ 822.436310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.436310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.436476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.436616] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf2c4153-8d36-459c-80b4-7a1d6df88c9d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.966302] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.966302] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.966302] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.966302] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.966302] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.966302] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf2c4153-8d36-459c-80b4-7a1d6df88c9d already deleted. [ 822.966302] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf2c4153-8d36-459c-80b4-7a1d6df88c9d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.520439] env[69789]: INFO networking_nsxv3.common.synchronization [None req-20bbc38f-11c2-4b83-88e6-a7c7c3a568c2 None None] Enqueued Resource ID: 77fe3f8a-361c-450d-a8d8-9110a0c3ec45 with Priority: HIGHEST for action port [ 823.520692] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77fe3f8a-361c-450d-a8d8-9110a0c3ec45 with Priority: HIGHEST for action port [ 823.521306] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-77fe3f8a-361c-450d-a8d8-9110a0c3ec45 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.521421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77fe3f8a-361c-450d-a8d8-9110a0c3ec45" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.521510] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77fe3f8a-361c-450d-a8d8-9110a0c3ec45" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.521800] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77fe3f8a-361c-450d-a8d8-9110a0c3ec45" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.521879] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77fe3f8a-361c-450d-a8d8-9110a0c3ec45',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.024425] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77fe3f8a-361c-450d-a8d8-9110a0c3ec45 [ 824.025581] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.025581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.025581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.025581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.025581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.025581] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77fe3f8a-361c-450d-a8d8-9110a0c3ec45 already deleted. [ 824.025581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77fe3f8a-361c-450d-a8d8-9110a0c3ec45" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.058450] env[69789]: INFO networking_nsxv3.common.synchronization [None req-3e9053bf-97e7-4ec7-8e4e-b49149efac7d None None] Enqueued Resource ID: bcf2e379-2887-46ca-bd7c-276eece97506 with Priority: HIGHEST for action port [ 826.058450] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf2e379-2887-46ca-bd7c-276eece97506 with Priority: HIGHEST for action port [ 826.058450] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcf2e379-2887-46ca-bd7c-276eece97506 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.058450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcf2e379-2887-46ca-bd7c-276eece97506" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.058450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcf2e379-2887-46ca-bd7c-276eece97506" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.058450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcf2e379-2887-46ca-bd7c-276eece97506" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.059441] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf2e379-2887-46ca-bd7c-276eece97506',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.561347] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcf2e379-2887-46ca-bd7c-276eece97506 [ 826.561616] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.561755] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.561825] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.562075] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.562177] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.562276] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcf2e379-2887-46ca-bd7c-276eece97506 already deleted. [ 826.562357] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcf2e379-2887-46ca-bd7c-276eece97506" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.837679] env[69789]: INFO networking_nsxv3.common.synchronization [None req-3d343c28-d3d6-4c73-9835-f551726003b3 None None] Enqueued Resource ID: eea8f9c0-01a2-42fc-89b3-e025cec5ae79 with Priority: HIGHEST for action port [ 827.838211] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea8f9c0-01a2-42fc-89b3-e025cec5ae79 with Priority: HIGHEST for action port [ 827.838508] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-eea8f9c0-01a2-42fc-89b3-e025cec5ae79 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.838632] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eea8f9c0-01a2-42fc-89b3-e025cec5ae79" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.838702] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eea8f9c0-01a2-42fc-89b3-e025cec5ae79" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.838951] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eea8f9c0-01a2-42fc-89b3-e025cec5ae79" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.841880] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eea8f9c0-01a2-42fc-89b3-e025cec5ae79',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.345490] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eea8f9c0-01a2-42fc-89b3-e025cec5ae79 [ 828.346818] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.346818] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.346818] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.346818] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.346818] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.346818] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eea8f9c0-01a2-42fc-89b3-e025cec5ae79 already deleted. [ 828.346818] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eea8f9c0-01a2-42fc-89b3-e025cec5ae79" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.518068] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a08723a7-8fc1-4115-8068-a6699593e512 None None] Enqueued Resource ID: a36b4b16-729e-4ed3-9369-56b396f9c759 with Priority: HIGHEST for action port [ 831.518424] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36b4b16-729e-4ed3-9369-56b396f9c759 with Priority: HIGHEST for action port [ 831.518898] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-a36b4b16-729e-4ed3-9369-56b396f9c759 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.519053] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a36b4b16-729e-4ed3-9369-56b396f9c759" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.519127] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a36b4b16-729e-4ed3-9369-56b396f9c759" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.519386] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a36b4b16-729e-4ed3-9369-56b396f9c759" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.519472] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a36b4b16-729e-4ed3-9369-56b396f9c759',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.024421] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a36b4b16-729e-4ed3-9369-56b396f9c759 [ 832.024421] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.024421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.024421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.024421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.024421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.024421] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a36b4b16-729e-4ed3-9369-56b396f9c759 already deleted. [ 832.024421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a36b4b16-729e-4ed3-9369-56b396f9c759" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.407555] env[69789]: INFO networking_nsxv3.common.synchronization [None req-fd5dda7b-4859-4bb5-a803-182ec5a8217a tempest-AttachVolumeTestJSON-2145518873 tempest-AttachVolumeTestJSON-2145518873-project-member] Enqueued Resource ID: 10d5a434-db9d-4b22-8e57-28dcc6e28ac8 with Priority: HIGHEST for action security_group_rules [ 832.408189] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d5a434-db9d-4b22-8e57-28dcc6e28ac8 with Priority: HIGHEST for action security_group_rules [ 832.408426] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.408562] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.408632] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.409013] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.409135] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10d5a434-db9d-4b22-8e57-28dcc6e28ac8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.503245] env[69789]: INFO networking_nsxv3.common.synchronization [None req-be34bcc7-15cc-44b8-afa3-5b80586a96ce tempest-AttachVolumeTestJSON-2145518873 tempest-AttachVolumeTestJSON-2145518873-project-member] Enqueued Resource ID: 10d5a434-db9d-4b22-8e57-28dcc6e28ac8 with Priority: HIGHEST for action security_group_rules [ 832.503905] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d5a434-db9d-4b22-8e57-28dcc6e28ac8 with Priority: HIGHEST for action security_group_rules [ 832.504433] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.504551] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.937061] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.937061] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.937061] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.937569] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.937569] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.937569] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10d5a434-db9d-4b22-8e57-28dcc6e28ac8 already deleted. [ 832.937569] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.937719] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.937967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.937967] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10d5a434-db9d-4b22-8e57-28dcc6e28ac8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.465283] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.465361] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.465432] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.466063] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.466063] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.466063] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10d5a434-db9d-4b22-8e57-28dcc6e28ac8 already deleted. [ 833.466063] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10d5a434-db9d-4b22-8e57-28dcc6e28ac8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.736946] env[69789]: INFO networking_nsxv3.common.synchronization [None req-d7dd84d9-5b2c-404d-a55b-09fea5f3755b None None] Enqueued Resource ID: a599ce7a-7b51-4250-8c9e-a68cd721a0fb with Priority: HIGHEST for action port [ 833.737563] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a599ce7a-7b51-4250-8c9e-a68cd721a0fb with Priority: HIGHEST for action port [ 833.737798] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-a599ce7a-7b51-4250-8c9e-a68cd721a0fb taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.737912] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a599ce7a-7b51-4250-8c9e-a68cd721a0fb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.737979] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a599ce7a-7b51-4250-8c9e-a68cd721a0fb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.738249] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a599ce7a-7b51-4250-8c9e-a68cd721a0fb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.738332] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a599ce7a-7b51-4250-8c9e-a68cd721a0fb',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.240743] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a599ce7a-7b51-4250-8c9e-a68cd721a0fb [ 834.240743] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.240743] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.240743] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.241880] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.241880] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.241880] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a599ce7a-7b51-4250-8c9e-a68cd721a0fb already deleted. [ 834.241880] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a599ce7a-7b51-4250-8c9e-a68cd721a0fb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.739723] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 838.739723] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 840.926517] env[69789]: INFO networking_nsxv3.common.synchronization [None req-24f74822-dc98-4d86-ac9a-d5332ffc3c4c None None] Enqueued Resource ID: 72cd68ba-9047-4bc1-909d-2101221c2b4e with Priority: HIGHEST for action port [ 840.926517] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72cd68ba-9047-4bc1-909d-2101221c2b4e with Priority: HIGHEST for action port [ 840.926880] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-72cd68ba-9047-4bc1-909d-2101221c2b4e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.926880] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72cd68ba-9047-4bc1-909d-2101221c2b4e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.926969] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72cd68ba-9047-4bc1-909d-2101221c2b4e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.929386] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72cd68ba-9047-4bc1-909d-2101221c2b4e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.929516] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72cd68ba-9047-4bc1-909d-2101221c2b4e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.432478] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72cd68ba-9047-4bc1-909d-2101221c2b4e [ 841.432478] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.432478] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.432478] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.432478] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.432478] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.432478] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72cd68ba-9047-4bc1-909d-2101221c2b4e already deleted. [ 841.432478] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72cd68ba-9047-4bc1-909d-2101221c2b4e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.621054] env[69789]: INFO networking_nsxv3.common.synchronization [None req-616bf299-13b2-4f6d-a5f6-b610f744099e None None] Enqueued Resource ID: 7e133aac-5a68-4dc7-9fd6-457678192458 with Priority: HIGHEST for action port [ 845.623050] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e133aac-5a68-4dc7-9fd6-457678192458 with Priority: HIGHEST for action port [ 845.623543] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e133aac-5a68-4dc7-9fd6-457678192458 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.623933] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e133aac-5a68-4dc7-9fd6-457678192458" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.624177] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e133aac-5a68-4dc7-9fd6-457678192458" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.624768] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e133aac-5a68-4dc7-9fd6-457678192458" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.624926] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e133aac-5a68-4dc7-9fd6-457678192458',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.128060] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e133aac-5a68-4dc7-9fd6-457678192458 [ 846.128298] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.128432] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.128501] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.128709] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.128799] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.128893] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e133aac-5a68-4dc7-9fd6-457678192458 already deleted. [ 846.128975] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e133aac-5a68-4dc7-9fd6-457678192458" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.046779] env[69789]: INFO networking_nsxv3.common.synchronization [None req-5e1a0f94-2fc0-43f4-961f-2708c6aff048 None None] Enqueued Resource ID: d4b15d29-a233-4fcc-b3eb-139f0e027be4 with Priority: HIGHEST for action port [ 848.047337] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4b15d29-a233-4fcc-b3eb-139f0e027be4 with Priority: HIGHEST for action port [ 848.047647] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4b15d29-a233-4fcc-b3eb-139f0e027be4 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.047772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4b15d29-a233-4fcc-b3eb-139f0e027be4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.047846] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4b15d29-a233-4fcc-b3eb-139f0e027be4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.049811] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4b15d29-a233-4fcc-b3eb-139f0e027be4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.049811] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4b15d29-a233-4fcc-b3eb-139f0e027be4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.550613] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4b15d29-a233-4fcc-b3eb-139f0e027be4 [ 848.551114] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.551312] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.551379] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.551554] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.551648] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.551745] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4b15d29-a233-4fcc-b3eb-139f0e027be4 already deleted. [ 848.551825] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4b15d29-a233-4fcc-b3eb-139f0e027be4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.572072] env[69789]: INFO networking_nsxv3.common.synchronization [None req-2c6bd2bc-0527-4145-9475-4c10d7db09fe None None] Enqueued Resource ID: 8c68cbbd-6f75-475f-968d-e9f60fb5973d with Priority: HIGHEST for action port [ 848.573551] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c68cbbd-6f75-475f-968d-e9f60fb5973d with Priority: HIGHEST for action port [ 848.574611] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c68cbbd-6f75-475f-968d-e9f60fb5973d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.574794] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c68cbbd-6f75-475f-968d-e9f60fb5973d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.574885] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c68cbbd-6f75-475f-968d-e9f60fb5973d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.575402] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c68cbbd-6f75-475f-968d-e9f60fb5973d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.575518] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c68cbbd-6f75-475f-968d-e9f60fb5973d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.080417] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c68cbbd-6f75-475f-968d-e9f60fb5973d [ 849.080703] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.080777] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.080844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.081104] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.081207] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.081318] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c68cbbd-6f75-475f-968d-e9f60fb5973d already deleted. [ 849.081405] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c68cbbd-6f75-475f-968d-e9f60fb5973d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.492358] env[69789]: INFO networking_nsxv3.common.synchronization [None req-74c73da2-0b0b-444d-a6e7-db6a27c512f0 None None] Enqueued Resource ID: 5ac4ef55-1055-40c8-b1fa-93465b80fca7 with Priority: HIGHEST for action port [ 850.492358] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ac4ef55-1055-40c8-b1fa-93465b80fca7 with Priority: HIGHEST for action port [ 850.492358] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ac4ef55-1055-40c8-b1fa-93465b80fca7 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.492358] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ac4ef55-1055-40c8-b1fa-93465b80fca7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.492358] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ac4ef55-1055-40c8-b1fa-93465b80fca7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.492358] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ac4ef55-1055-40c8-b1fa-93465b80fca7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.492358] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ac4ef55-1055-40c8-b1fa-93465b80fca7',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.997107] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ac4ef55-1055-40c8-b1fa-93465b80fca7 [ 850.997107] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.997107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.997107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.997107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.997107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.997107] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ac4ef55-1055-40c8-b1fa-93465b80fca7 already deleted. [ 850.997107] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ac4ef55-1055-40c8-b1fa-93465b80fca7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.178320] env[69789]: INFO networking_nsxv3.common.synchronization [None req-162a2c52-2f81-4c8b-980f-d3312a22ad31 None None] Enqueued Resource ID: 9f304f92-521d-476c-ae08-4b11f445ff42 with Priority: HIGHEST for action port [ 855.178670] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f304f92-521d-476c-ae08-4b11f445ff42 with Priority: HIGHEST for action port [ 855.179172] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f304f92-521d-476c-ae08-4b11f445ff42 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.179338] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f304f92-521d-476c-ae08-4b11f445ff42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.179390] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f304f92-521d-476c-ae08-4b11f445ff42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.179726] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f304f92-521d-476c-ae08-4b11f445ff42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.179836] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f304f92-521d-476c-ae08-4b11f445ff42',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.682950] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f304f92-521d-476c-ae08-4b11f445ff42 [ 855.683811] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.683811] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.683811] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.683811] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.683811] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.683811] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f304f92-521d-476c-ae08-4b11f445ff42 already deleted. [ 855.684111] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f304f92-521d-476c-ae08-4b11f445ff42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.276359] env[69789]: INFO networking_nsxv3.common.synchronization [None req-ee463492-46e4-4497-86f7-ee1185875c6f None None] Enqueued Resource ID: 7b4abcfd-6742-46a2-ab49-7ee19aa348a6 with Priority: HIGHEST for action port [ 857.276359] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b4abcfd-6742-46a2-ab49-7ee19aa348a6 with Priority: HIGHEST for action port [ 857.276359] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b4abcfd-6742-46a2-ab49-7ee19aa348a6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.276359] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b4abcfd-6742-46a2-ab49-7ee19aa348a6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.276359] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b4abcfd-6742-46a2-ab49-7ee19aa348a6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.276359] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b4abcfd-6742-46a2-ab49-7ee19aa348a6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.276359] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b4abcfd-6742-46a2-ab49-7ee19aa348a6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.778656] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b4abcfd-6742-46a2-ab49-7ee19aa348a6 [ 857.778896] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.779050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.779123] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.779348] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.779444] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.779550] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b4abcfd-6742-46a2-ab49-7ee19aa348a6 already deleted. [ 857.779651] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b4abcfd-6742-46a2-ab49-7ee19aa348a6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.275460] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 862.275738] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 867.280619] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 867.280619] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 870.076447] env[69789]: INFO networking_nsxv3.common.synchronization [None req-847dd52d-a0ca-492a-9a6f-7e90290e3f0f None None] Enqueued Resource ID: 33dc376d-1597-46f9-8784-83712cf7eb73 with Priority: HIGHEST for action port [ 870.076748] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33dc376d-1597-46f9-8784-83712cf7eb73 with Priority: HIGHEST for action port [ 870.077605] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-33dc376d-1597-46f9-8784-83712cf7eb73 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.077753] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33dc376d-1597-46f9-8784-83712cf7eb73" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.077824] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33dc376d-1597-46f9-8784-83712cf7eb73" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.080172] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33dc376d-1597-46f9-8784-83712cf7eb73" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.080285] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33dc376d-1597-46f9-8784-83712cf7eb73',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.583515] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33dc376d-1597-46f9-8784-83712cf7eb73 [ 870.583862] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.584122] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.584216] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.584443] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.584572] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.584680] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33dc376d-1597-46f9-8784-83712cf7eb73 already deleted. [ 870.584802] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33dc376d-1597-46f9-8784-83712cf7eb73" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.325439] env[69789]: INFO networking_nsxv3.common.synchronization [None req-7ab6a156-bc3b-4a4e-a1ea-040e2af04c61 None None] Enqueued Resource ID: 1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8 with Priority: HIGHEST for action port [ 872.328299] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8 with Priority: HIGHEST for action port [ 872.328299] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.328299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.328299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.328299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.328299] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.830362] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8 [ 872.830362] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.830362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.830362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.830362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.830362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.830362] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8 already deleted. [ 872.830362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fb485e3-bb3d-4f53-b8e7-3f5ecf2633c8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.328031] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 877.328444] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 880.569336] env[69789]: INFO networking_nsxv3.common.synchronization [None req-5add8052-8150-455a-9daa-56e50eb6bc77 None None] Enqueued Resource ID: d860946c-7afd-40ac-b2c3-2f479d77aa71 with Priority: HIGHEST for action port [ 880.569336] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d860946c-7afd-40ac-b2c3-2f479d77aa71 with Priority: HIGHEST for action port [ 880.569779] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-d860946c-7afd-40ac-b2c3-2f479d77aa71 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.569905] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d860946c-7afd-40ac-b2c3-2f479d77aa71" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.569971] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d860946c-7afd-40ac-b2c3-2f479d77aa71" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.570246] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d860946c-7afd-40ac-b2c3-2f479d77aa71" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.570329] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d860946c-7afd-40ac-b2c3-2f479d77aa71',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.072401] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d860946c-7afd-40ac-b2c3-2f479d77aa71 [ 881.072623] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.072759] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.072826] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.073046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.073138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.073233] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d860946c-7afd-40ac-b2c3-2f479d77aa71 already deleted. [ 881.073314] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d860946c-7afd-40ac-b2c3-2f479d77aa71" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.292796] env[69789]: INFO networking_nsxv3.common.synchronization [None req-19be0f13-5123-479b-895f-ced5fd4d19bb tempest-AttachVolumeShelveTestJSON-258170 tempest-AttachVolumeShelveTestJSON-258170-project-member] Enqueued Resource ID: 18b49941-1e36-41ec-88d0-929694f953dc with Priority: HIGHEST for action security_group_rules [ 881.293329] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b49941-1e36-41ec-88d0-929694f953dc with Priority: HIGHEST for action security_group_rules [ 881.293660] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b49941-1e36-41ec-88d0-929694f953dc taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.293787] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b49941-1e36-41ec-88d0-929694f953dc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.293857] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b49941-1e36-41ec-88d0-929694f953dc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.297692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b49941-1e36-41ec-88d0-929694f953dc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.297793] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b49941-1e36-41ec-88d0-929694f953dc',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.427392] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a69fecf8-26b7-49f8-8439-46353292329e tempest-AttachVolumeShelveTestJSON-258170 tempest-AttachVolumeShelveTestJSON-258170-project-member] Enqueued Resource ID: 18b49941-1e36-41ec-88d0-929694f953dc with Priority: HIGHEST for action security_group_rules [ 881.427392] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b49941-1e36-41ec-88d0-929694f953dc with Priority: HIGHEST for action security_group_rules [ 881.427392] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b49941-1e36-41ec-88d0-929694f953dc taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.427392] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b49941-1e36-41ec-88d0-929694f953dc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.825241] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.825563] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.825563] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.825678] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.825783] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.825884] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b49941-1e36-41ec-88d0-929694f953dc already deleted. [ 881.826227] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b49941-1e36-41ec-88d0-929694f953dc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.826227] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b49941-1e36-41ec-88d0-929694f953dc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.826419] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b49941-1e36-41ec-88d0-929694f953dc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.826419] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b49941-1e36-41ec-88d0-929694f953dc',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.357844] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.357844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.357844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.357844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.357844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.357844] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b49941-1e36-41ec-88d0-929694f953dc already deleted. [ 882.357844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b49941-1e36-41ec-88d0-929694f953dc" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.937538] env[69789]: INFO networking_nsxv3.common.synchronization [None req-4c07d1ab-7f74-4e08-80d4-479d73ca9f45 None None] Enqueued Resource ID: ff713c04-3bd2-48fd-b6eb-163c8f57355a with Priority: HIGHEST for action port [ 882.937538] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff713c04-3bd2-48fd-b6eb-163c8f57355a with Priority: HIGHEST for action port [ 882.937538] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff713c04-3bd2-48fd-b6eb-163c8f57355a taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.937538] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff713c04-3bd2-48fd-b6eb-163c8f57355a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.937538] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff713c04-3bd2-48fd-b6eb-163c8f57355a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.938163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff713c04-3bd2-48fd-b6eb-163c8f57355a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.938163] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff713c04-3bd2-48fd-b6eb-163c8f57355a',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.440115] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff713c04-3bd2-48fd-b6eb-163c8f57355a [ 883.440827] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.440827] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.440827] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.440973] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.440973] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.441100] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff713c04-3bd2-48fd-b6eb-163c8f57355a already deleted. [ 883.441198] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff713c04-3bd2-48fd-b6eb-163c8f57355a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.434021] env[69789]: INFO networking_nsxv3.common.synchronization [None req-26b0d361-0d3e-420e-aff9-2380a51cc412 None None] Enqueued Resource ID: e0b2179e-af52-41cd-9a2e-70d0932f16f1 with Priority: HIGHEST for action port [ 884.434021] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0b2179e-af52-41cd-9a2e-70d0932f16f1 with Priority: HIGHEST for action port [ 884.435720] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0b2179e-af52-41cd-9a2e-70d0932f16f1 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.435720] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0b2179e-af52-41cd-9a2e-70d0932f16f1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.435720] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0b2179e-af52-41cd-9a2e-70d0932f16f1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.438211] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0b2179e-af52-41cd-9a2e-70d0932f16f1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.438211] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0b2179e-af52-41cd-9a2e-70d0932f16f1',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.939368] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0b2179e-af52-41cd-9a2e-70d0932f16f1 [ 884.939606] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.941716] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.941716] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.941716] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.941716] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.941716] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0b2179e-af52-41cd-9a2e-70d0932f16f1 already deleted. [ 884.941716] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0b2179e-af52-41cd-9a2e-70d0932f16f1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.253113] env[69789]: INFO networking_nsxv3.common.synchronization [None req-deca30fc-90bf-46bf-88e0-6ecdd5ae5047 None None] Enqueued Resource ID: 117126d1-f17d-44b6-9f9a-f24761794e32 with Priority: HIGHEST for action port [ 886.253596] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 117126d1-f17d-44b6-9f9a-f24761794e32 with Priority: HIGHEST for action port [ 886.253909] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-117126d1-f17d-44b6-9f9a-f24761794e32 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.254679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-117126d1-f17d-44b6-9f9a-f24761794e32" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.254779] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-117126d1-f17d-44b6-9f9a-f24761794e32" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.255095] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-117126d1-f17d-44b6-9f9a-f24761794e32" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.255190] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117126d1-f17d-44b6-9f9a-f24761794e32',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.525299] env[69789]: INFO networking_nsxv3.common.synchronization [None req-8ea924d8-2f65-448b-8b1e-14f138c81914 None None] Enqueued Resource ID: 4c30ba30-4cea-4bba-8eb9-6fb8bedc489f with Priority: HIGHEST for action port [ 886.525299] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c30ba30-4cea-4bba-8eb9-6fb8bedc489f with Priority: HIGHEST for action port [ 886.525299] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c30ba30-4cea-4bba-8eb9-6fb8bedc489f taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.525299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c30ba30-4cea-4bba-8eb9-6fb8bedc489f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.525299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c30ba30-4cea-4bba-8eb9-6fb8bedc489f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.525299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c30ba30-4cea-4bba-8eb9-6fb8bedc489f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.525299] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c30ba30-4cea-4bba-8eb9-6fb8bedc489f',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.756736] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 117126d1-f17d-44b6-9f9a-f24761794e32 [ 886.756997] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.757179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.757276] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.757458] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.758681] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.758820] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:117126d1-f17d-44b6-9f9a-f24761794e32 already deleted. [ 886.758925] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-117126d1-f17d-44b6-9f9a-f24761794e32" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.026983] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c30ba30-4cea-4bba-8eb9-6fb8bedc489f [ 887.027730] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.027730] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.027730] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.027730] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.027730] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.028196] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c30ba30-4cea-4bba-8eb9-6fb8bedc489f already deleted. [ 887.028196] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c30ba30-4cea-4bba-8eb9-6fb8bedc489f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.600341] env[69789]: INFO networking_nsxv3.common.synchronization [None req-1054d551-e546-47ff-8048-f6252c12497d None None] Enqueued Resource ID: f195c9a8-ad80-4860-90ef-e2406fd06967 with Priority: HIGHEST for action port [ 888.601115] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f195c9a8-ad80-4860-90ef-e2406fd06967 with Priority: HIGHEST for action port [ 888.601207] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-f195c9a8-ad80-4860-90ef-e2406fd06967 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.601340] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f195c9a8-ad80-4860-90ef-e2406fd06967" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.601416] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f195c9a8-ad80-4860-90ef-e2406fd06967" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.601666] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f195c9a8-ad80-4860-90ef-e2406fd06967" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.601749] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f195c9a8-ad80-4860-90ef-e2406fd06967',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.103672] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f195c9a8-ad80-4860-90ef-e2406fd06967 [ 889.105030] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.105030] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.105030] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.105030] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.105030] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.105030] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f195c9a8-ad80-4860-90ef-e2406fd06967 already deleted. [ 889.105295] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f195c9a8-ad80-4860-90ef-e2406fd06967" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.323027] env[69789]: INFO networking_nsxv3.common.synchronization [None req-adb58510-4975-49ca-9f05-424f61ae529d tempest-AttachInterfacesTestJSON-527541319 tempest-AttachInterfacesTestJSON-527541319-project-member] Enqueued Resource ID: 2e9d09b1-8ce3-4324-8588-ee65b0305ac7 with Priority: HIGHEST for action security_group_rules [ 889.323948] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e9d09b1-8ce3-4324-8588-ee65b0305ac7 with Priority: HIGHEST for action security_group_rules [ 889.324938] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.325093] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.325163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.325421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.325507] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e9d09b1-8ce3-4324-8588-ee65b0305ac7',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.398597] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a592b41a-2c01-4168-8d42-31016e33ad5a tempest-AttachInterfacesTestJSON-527541319 tempest-AttachInterfacesTestJSON-527541319-project-member] Enqueued Resource ID: 2e9d09b1-8ce3-4324-8588-ee65b0305ac7 with Priority: HIGHEST for action security_group_rules [ 889.398597] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e9d09b1-8ce3-4324-8588-ee65b0305ac7 with Priority: HIGHEST for action security_group_rules [ 889.398597] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.398597] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.846472] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.846962] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.847058] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.848150] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.848284] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.848392] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e9d09b1-8ce3-4324-8588-ee65b0305ac7 already deleted. [ 889.848561] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.848666] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.848844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.848926] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e9d09b1-8ce3-4324-8588-ee65b0305ac7',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.371035] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.371195] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.371277] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.371546] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.371655] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.371757] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e9d09b1-8ce3-4324-8588-ee65b0305ac7 already deleted. [ 890.371851] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e9d09b1-8ce3-4324-8588-ee65b0305ac7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.011549] env[69789]: INFO networking_nsxv3.common.synchronization [None req-fb4d3268-f98c-4090-bed9-99c94b60476f None None] Enqueued Resource ID: 87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789 with Priority: HIGHEST for action port [ 894.011800] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789 with Priority: HIGHEST for action port [ 894.012361] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.012751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.012751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.012856] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.012891] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.516692] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789 [ 894.517181] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.517470] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.517633] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.518025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.518338] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.518955] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789 already deleted. [ 894.519144] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87e8ca39-3cf5-4257-b2ae-3b9e8cdfc789" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.717642] env[69789]: INFO networking_nsxv3.common.synchronization [None req-de4c3776-8581-4a1f-bb3f-2de1e3f20dd1 tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 08c6d114-a7a8-45d1-abb4-248142239a51 with Priority: HIGHEST for action security_group_rules [ 895.718642] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08c6d114-a7a8-45d1-abb4-248142239a51 with Priority: HIGHEST for action security_group_rules [ 895.718642] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08c6d114-a7a8-45d1-abb4-248142239a51 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.718898] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08c6d114-a7a8-45d1-abb4-248142239a51" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.718898] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08c6d114-a7a8-45d1-abb4-248142239a51" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.719445] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08c6d114-a7a8-45d1-abb4-248142239a51" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.719445] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08c6d114-a7a8-45d1-abb4-248142239a51',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.969295] env[69789]: INFO networking_nsxv3.common.synchronization [None req-c46fc144-0213-4b6f-b324-824a6e24ce3e None None] Enqueued Resource ID: c4e7738f-767f-4072-9f4f-4ac6c4de2b6b with Priority: HIGHEST for action port [ 895.969788] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4e7738f-767f-4072-9f4f-4ac6c4de2b6b with Priority: HIGHEST for action port [ 895.970760] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4e7738f-767f-4072-9f4f-4ac6c4de2b6b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.971062] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4e7738f-767f-4072-9f4f-4ac6c4de2b6b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.971062] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4e7738f-767f-4072-9f4f-4ac6c4de2b6b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.971332] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4e7738f-767f-4072-9f4f-4ac6c4de2b6b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.971406] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4e7738f-767f-4072-9f4f-4ac6c4de2b6b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.223024] env[69789]: INFO networking_nsxv3.common.synchronization [None req-ad18d16e-d01f-42f5-9fdb-d433767db6eb tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 08c6d114-a7a8-45d1-abb4-248142239a51 with Priority: HIGHEST for action security_group_rules [ 896.224130] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08c6d114-a7a8-45d1-abb4-248142239a51 with Priority: HIGHEST for action security_group_rules [ 896.224514] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08c6d114-a7a8-45d1-abb4-248142239a51 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.224661] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08c6d114-a7a8-45d1-abb4-248142239a51" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.249475] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.249685] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.249685] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.250658] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.250658] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.250658] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08c6d114-a7a8-45d1-abb4-248142239a51 already deleted. [ 896.250658] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08c6d114-a7a8-45d1-abb4-248142239a51" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.250658] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08c6d114-a7a8-45d1-abb4-248142239a51" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.251250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08c6d114-a7a8-45d1-abb4-248142239a51" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.252226] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08c6d114-a7a8-45d1-abb4-248142239a51',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.474118] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4e7738f-767f-4072-9f4f-4ac6c4de2b6b [ 896.474118] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.474118] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.474118] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.474282] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.474372] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.474463] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4e7738f-767f-4072-9f4f-4ac6c4de2b6b already deleted. [ 896.474546] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4e7738f-767f-4072-9f4f-4ac6c4de2b6b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.554565] env[69789]: INFO networking_nsxv3.common.synchronization [None req-9e218604-63c7-4b24-ad8b-2304d1d24d1f None None] Enqueued Resource ID: 2d61200d-7c09-44c5-b98d-a69ad5268a99 with Priority: HIGHEST for action port [ 896.554565] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d61200d-7c09-44c5-b98d-a69ad5268a99 with Priority: HIGHEST for action port [ 896.554565] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d61200d-7c09-44c5-b98d-a69ad5268a99 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.554565] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d61200d-7c09-44c5-b98d-a69ad5268a99" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.554565] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d61200d-7c09-44c5-b98d-a69ad5268a99" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.554565] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d61200d-7c09-44c5-b98d-a69ad5268a99" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.554565] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d61200d-7c09-44c5-b98d-a69ad5268a99',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.775394] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.775732] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.775732] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.775876] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.775982] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.776131] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08c6d114-a7a8-45d1-abb4-248142239a51 already deleted. [ 896.776200] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08c6d114-a7a8-45d1-abb4-248142239a51" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.061411] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d61200d-7c09-44c5-b98d-a69ad5268a99 [ 897.061618] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.061730] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.061730] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.062401] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.062401] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.062401] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d61200d-7c09-44c5-b98d-a69ad5268a99 already deleted. [ 897.062401] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d61200d-7c09-44c5-b98d-a69ad5268a99" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.684723] env[69789]: INFO networking_nsxv3.common.synchronization [None req-0bc20eed-4e34-49c0-a132-5b36007a0c0a None None] Enqueued Resource ID: 5b7446ab-7095-42cb-9228-6424c64d4d15 with Priority: HIGHEST for action port [ 898.684723] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b7446ab-7095-42cb-9228-6424c64d4d15 with Priority: HIGHEST for action port [ 898.685172] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b7446ab-7095-42cb-9228-6424c64d4d15 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.685172] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b7446ab-7095-42cb-9228-6424c64d4d15" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.685172] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b7446ab-7095-42cb-9228-6424c64d4d15" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.685424] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b7446ab-7095-42cb-9228-6424c64d4d15" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.685507] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b7446ab-7095-42cb-9228-6424c64d4d15',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.187313] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b7446ab-7095-42cb-9228-6424c64d4d15 [ 899.187544] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.187682] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.187751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.187969] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.188073] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.188168] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b7446ab-7095-42cb-9228-6424c64d4d15 already deleted. [ 899.188251] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b7446ab-7095-42cb-9228-6424c64d4d15" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.512153] env[69789]: INFO networking_nsxv3.common.synchronization [req-e0d14fa8-8665-4c15-bb30-7ff818a02951 req-ed34a0f8-41c9-4173-a950-d76787719ab1 tempest-VolumesAdminNegativeTest-161696083 tempest-VolumesAdminNegativeTest-161696083-project-member] Enqueued Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_members [ 903.512973] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGHEST for action security_group_members [ 903.513497] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-367b3953-c384-4a92-8d77-5aeea593412d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.514393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.514393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.514393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.514393] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.514393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.514393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.514780] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.515019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.515660] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.020797] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.020797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.020797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.020797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.020797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.020797] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.020797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.020797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.020797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.020797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.020797] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 367b3953-c384-4a92-8d77-5aeea593412d is going to be updated. [ 904.057433] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.057569] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.057638] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.057850] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.061020] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.069361] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 367b3953-c384-4a92-8d77-5aeea593412d in Status: IN_PROGRESS for 2s [ 905.433273] env[69789]: INFO networking_nsxv3.common.synchronization [None req-8abe6e48-3cbf-4127-9bae-856ba2537593 None None] Enqueued Resource ID: 481526ec-7889-4a6d-86b3-f4a12e1f4844 with Priority: HIGHEST for action port [ 905.433582] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 481526ec-7889-4a6d-86b3-f4a12e1f4844 with Priority: HIGHEST for action port [ 905.434133] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-481526ec-7889-4a6d-86b3-f4a12e1f4844 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.434254] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-481526ec-7889-4a6d-86b3-f4a12e1f4844" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.434254] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-481526ec-7889-4a6d-86b3-f4a12e1f4844" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.434508] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-481526ec-7889-4a6d-86b3-f4a12e1f4844" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.434655] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('481526ec-7889-4a6d-86b3-f4a12e1f4844',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.682507] env[69789]: INFO networking_nsxv3.common.synchronization [None req-80a93aba-5b9c-4a68-b410-c69bd00b7d1e tempest-AttachVolumeTestJSON-2145518873 tempest-AttachVolumeTestJSON-2145518873-project-member] Enqueued Resource ID: 157a3de0-05c9-40d1-a946-04dc00386686 with Priority: HIGHEST for action security_group_rules [ 905.683070] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 157a3de0-05c9-40d1-a946-04dc00386686 with Priority: HIGHEST for action security_group_rules [ 905.683389] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-157a3de0-05c9-40d1-a946-04dc00386686 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.683517] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-157a3de0-05c9-40d1-a946-04dc00386686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.683586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-157a3de0-05c9-40d1-a946-04dc00386686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.683867] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-157a3de0-05c9-40d1-a946-04dc00386686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.683953] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('157a3de0-05c9-40d1-a946-04dc00386686',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.771927] env[69789]: INFO networking_nsxv3.common.synchronization [None req-c24c4284-7ac5-4c4e-aacc-ce56606d2e58 tempest-AttachVolumeTestJSON-2145518873 tempest-AttachVolumeTestJSON-2145518873-project-member] Enqueued Resource ID: 157a3de0-05c9-40d1-a946-04dc00386686 with Priority: HIGHEST for action security_group_rules [ 905.772602] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 157a3de0-05c9-40d1-a946-04dc00386686 with Priority: HIGHEST for action security_group_rules [ 905.772902] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-157a3de0-05c9-40d1-a946-04dc00386686 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.773017] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-157a3de0-05c9-40d1-a946-04dc00386686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.939433] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 481526ec-7889-4a6d-86b3-f4a12e1f4844 [ 905.939667] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.940450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.940450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.940450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.940450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.940450] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:481526ec-7889-4a6d-86b3-f4a12e1f4844 already deleted. [ 905.940450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-481526ec-7889-4a6d-86b3-f4a12e1f4844" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.084507] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 367b3953-c384-4a92-8d77-5aeea593412d in Status: SUCCESS [ 906.084723] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 367b3953-c384-4a92-8d77-5aeea593412d deletion is rescheduled due to dependency. [ 906.084833] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.210067] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.210517] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.210679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.210962] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.211717] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.213042] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 157a3de0-05c9-40d1-a946-04dc00386686 already deleted. [ 906.213232] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-157a3de0-05c9-40d1-a946-04dc00386686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.213827] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-157a3de0-05c9-40d1-a946-04dc00386686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.214881] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-157a3de0-05c9-40d1-a946-04dc00386686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.214881] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('157a3de0-05c9-40d1-a946-04dc00386686',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.735439] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.735713] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.735713] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.735787] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.736104] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.736104] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 157a3de0-05c9-40d1-a946-04dc00386686 already deleted. [ 906.736104] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-157a3de0-05c9-40d1-a946-04dc00386686" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.773308] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 910.773664] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 911.061381] env[69789]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 911.061542] env[69789]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] NSXv3 Agent Agent loop - iteration:1 started [ 912.670600] env[69789]: INFO networking_nsxv3.common.synchronization [None req-2947f06c-4daa-42bd-9ff4-6f6a53cb3526 None None] Enqueued Resource ID: b9bd6a31-bdd7-469f-8b38-00f4c814db47 with Priority: HIGHEST for action port [ 912.671067] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9bd6a31-bdd7-469f-8b38-00f4c814db47 with Priority: HIGHEST for action port [ 912.671588] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9bd6a31-bdd7-469f-8b38-00f4c814db47 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.671960] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9bd6a31-bdd7-469f-8b38-00f4c814db47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.672117] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9bd6a31-bdd7-469f-8b38-00f4c814db47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.672387] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9bd6a31-bdd7-469f-8b38-00f4c814db47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.672567] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9bd6a31-bdd7-469f-8b38-00f4c814db47',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.174496] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9bd6a31-bdd7-469f-8b38-00f4c814db47 [ 913.174936] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.175103] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.175178] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.175397] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.175488] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.175584] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9bd6a31-bdd7-469f-8b38-00f4c814db47 already deleted. [ 913.175669] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9bd6a31-bdd7-469f-8b38-00f4c814db47" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.864542] env[69789]: INFO networking_nsxv3.common.synchronization [None req-8e6d5083-4219-47e1-84f9-63cd0b80f89f None None] Enqueued Resource ID: d4ee8bd3-a138-4061-898c-0a5e0bcf79f5 with Priority: HIGHEST for action port [ 914.865494] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ee8bd3-a138-4061-898c-0a5e0bcf79f5 with Priority: HIGHEST for action port [ 914.865844] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4ee8bd3-a138-4061-898c-0a5e0bcf79f5 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.866209] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4ee8bd3-a138-4061-898c-0a5e0bcf79f5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.866330] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4ee8bd3-a138-4061-898c-0a5e0bcf79f5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.866630] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4ee8bd3-a138-4061-898c-0a5e0bcf79f5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.866719] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4ee8bd3-a138-4061-898c-0a5e0bcf79f5',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.370505] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4ee8bd3-a138-4061-898c-0a5e0bcf79f5 [ 915.370619] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.370701] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.370777] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.371034] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.371132] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.371232] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4ee8bd3-a138-4061-898c-0a5e0bcf79f5 already deleted. [ 915.371316] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4ee8bd3-a138-4061-898c-0a5e0bcf79f5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.866928] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 919.867324] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 924.608920] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a1791971-1bb5-4803-baa3-45e13555d03a tempest-AttachVolumeShelveTestJSON-258170 tempest-AttachVolumeShelveTestJSON-258170-project-member] Enqueued Resource ID: 256de8bb-4763-40dc-86e3-763559a8510a with Priority: HIGHEST for action security_group_rules [ 924.609463] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256de8bb-4763-40dc-86e3-763559a8510a with Priority: HIGHEST for action security_group_rules [ 924.609762] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256de8bb-4763-40dc-86e3-763559a8510a taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.609887] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256de8bb-4763-40dc-86e3-763559a8510a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.609953] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256de8bb-4763-40dc-86e3-763559a8510a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.610574] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256de8bb-4763-40dc-86e3-763559a8510a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.610667] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256de8bb-4763-40dc-86e3-763559a8510a',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.679098] env[69789]: INFO networking_nsxv3.common.synchronization [None req-4bda7969-b83c-4fef-b3d3-27700983bd10 tempest-AttachVolumeShelveTestJSON-258170 tempest-AttachVolumeShelveTestJSON-258170-project-member] Enqueued Resource ID: 256de8bb-4763-40dc-86e3-763559a8510a with Priority: HIGHEST for action security_group_rules [ 924.679098] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256de8bb-4763-40dc-86e3-763559a8510a with Priority: HIGHEST for action security_group_rules [ 924.679098] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256de8bb-4763-40dc-86e3-763559a8510a taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.679278] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256de8bb-4763-40dc-86e3-763559a8510a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.132593] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.136268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.136348] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.136579] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.136674] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.136773] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256de8bb-4763-40dc-86e3-763559a8510a already deleted. [ 925.136857] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256de8bb-4763-40dc-86e3-763559a8510a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.137017] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256de8bb-4763-40dc-86e3-763559a8510a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.137198] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256de8bb-4763-40dc-86e3-763559a8510a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.137316] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256de8bb-4763-40dc-86e3-763559a8510a',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.246126] env[69789]: INFO networking_nsxv3.common.synchronization [None req-60664f4d-ec9b-453f-86e5-bf015904167a None None] Enqueued Resource ID: 4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8 with Priority: HIGHEST for action port [ 925.246640] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8 with Priority: HIGHEST for action port [ 925.246950] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.247168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.247168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.247407] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.247886] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.658963] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.659278] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.659278] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.659418] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.659483] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.659582] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256de8bb-4763-40dc-86e3-763559a8510a already deleted. [ 925.659665] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256de8bb-4763-40dc-86e3-763559a8510a" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.750577] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8 [ 925.750887] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.751083] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.751183] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.751466] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.751585] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.751726] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8 already deleted. [ 925.751838] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cfaef96-9ddc-4d03-a9dd-dad2e8a6b8d8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.194998] env[69789]: INFO networking_nsxv3.common.synchronization [None req-08aea16f-c73e-4059-861d-fc47a08e19e3 None None] Enqueued Resource ID: a7066b39-6940-40f7-ba43-2ede6280a353 with Priority: HIGHEST for action port [ 927.195394] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7066b39-6940-40f7-ba43-2ede6280a353 with Priority: HIGHEST for action port [ 927.195936] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7066b39-6940-40f7-ba43-2ede6280a353 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.196060] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7066b39-6940-40f7-ba43-2ede6280a353" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.196441] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7066b39-6940-40f7-ba43-2ede6280a353" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.196743] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7066b39-6940-40f7-ba43-2ede6280a353" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.196779] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7066b39-6940-40f7-ba43-2ede6280a353',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.701497] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7066b39-6940-40f7-ba43-2ede6280a353 [ 927.701497] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.701497] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.701497] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.701497] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.701497] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.701497] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7066b39-6940-40f7-ba43-2ede6280a353 already deleted. [ 927.701497] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7066b39-6940-40f7-ba43-2ede6280a353" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.494963] env[69789]: INFO networking_nsxv3.common.synchronization [None req-dd822bae-8a69-4308-99e9-8d668c33a058 None None] Enqueued Resource ID: 92384148-7dd5-4c8e-947c-ff940b569d83 with Priority: HIGHEST for action port [ 928.495486] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92384148-7dd5-4c8e-947c-ff940b569d83 with Priority: HIGHEST for action port [ 928.495773] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-92384148-7dd5-4c8e-947c-ff940b569d83 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.495933] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92384148-7dd5-4c8e-947c-ff940b569d83" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.496007] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92384148-7dd5-4c8e-947c-ff940b569d83" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.496581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92384148-7dd5-4c8e-947c-ff940b569d83" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.496662] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92384148-7dd5-4c8e-947c-ff940b569d83',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.999851] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92384148-7dd5-4c8e-947c-ff940b569d83 [ 928.999851] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.999851] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.999851] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.999851] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.999851] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.000094] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92384148-7dd5-4c8e-947c-ff940b569d83 already deleted. [ 929.000094] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92384148-7dd5-4c8e-947c-ff940b569d83" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.329273] env[69789]: INFO networking_nsxv3.common.synchronization [None req-e6ab8f7b-2428-47bd-a698-8d46040204ac tempest-ServersTestFqdnHostnames-265094891 tempest-ServersTestFqdnHostnames-265094891-project-member] Enqueued Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_rules [ 929.329837] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_rules [ 929.330798] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03844cb4-294c-44e3-a590-26b53d6fb778 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.330798] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.330798] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.330798] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.330798] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.457649] env[69789]: INFO networking_nsxv3.common.synchronization [None req-5fa8f435-8bcf-4a41-9fbd-590c7633992b tempest-ServersTestFqdnHostnames-265094891 tempest-ServersTestFqdnHostnames-265094891-project-member] Enqueued Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_rules [ 929.458238] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_rules [ 929.458591] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03844cb4-294c-44e3-a590-26b53d6fb778 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.458777] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.852273] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.852582] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.852582] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.852695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.852783] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.852869] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03844cb4-294c-44e3-a590-26b53d6fb778 already deleted. [ 929.852949] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.853987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.853987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.853987] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.373165] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.373321] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.373388] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.374948] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.374948] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.374948] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03844cb4-294c-44e3-a590-26b53d6fb778 already deleted. [ 930.374948] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.754573] env[69789]: INFO networking_nsxv3.common.synchronization [None req-d0e9e6e6-27de-46bb-9bab-0bec4c16dbd8 None None] Enqueued Resource ID: 09c3a919-df4a-492f-b264-f4488c5d67f5 with Priority: HIGHEST for action port [ 930.754842] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09c3a919-df4a-492f-b264-f4488c5d67f5 with Priority: HIGHEST for action port [ 930.755437] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-09c3a919-df4a-492f-b264-f4488c5d67f5 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.755566] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09c3a919-df4a-492f-b264-f4488c5d67f5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.755632] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09c3a919-df4a-492f-b264-f4488c5d67f5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.755884] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09c3a919-df4a-492f-b264-f4488c5d67f5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.755967] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09c3a919-df4a-492f-b264-f4488c5d67f5',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.258229] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09c3a919-df4a-492f-b264-f4488c5d67f5 [ 931.258563] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.258630] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.258670] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.258889] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.258981] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.259095] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09c3a919-df4a-492f-b264-f4488c5d67f5 already deleted. [ 931.259178] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09c3a919-df4a-492f-b264-f4488c5d67f5" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.522487] env[69789]: INFO networking_nsxv3.common.synchronization [None req-d7d5013b-c43e-49c0-ac82-25656203951a tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_rules [ 933.523135] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_rules [ 933.523657] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.523657] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.523657] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.524041] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.524041] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.648938] env[69789]: INFO networking_nsxv3.common.synchronization [None req-1685a8c8-fc7b-48b8-b252-181ad9d33049 tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_rules [ 933.648938] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_rules [ 933.648938] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.648938] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.047961] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.048157] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.048264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.048522] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.048640] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.048772] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 already deleted. [ 934.048894] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.049137] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.049535] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.049661] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.577560] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.577845] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.577845] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.577981] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.578089] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.578189] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 already deleted. [ 934.578331] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.005761] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.005761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.005761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.005761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.005761] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.473282] env[69789]: INFO networking_nsxv3.common.synchronization [None req-3f6dfc52-837a-4c73-99a9-5d2c7975ad82 None None] Enqueued Resource ID: c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d with Priority: HIGHEST for action port [ 935.473282] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d with Priority: HIGHEST for action port [ 935.473282] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.473282] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.473282] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.473282] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.473282] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.510366] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.977491] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d [ 935.977491] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.977491] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.977491] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.977491] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.977491] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.977491] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d already deleted. [ 935.977971] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3abea4b-1e1b-46a1-bd49-2ef6cd7a210d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.012304] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.517717] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 936.517717] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 937.291954] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.292422] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.292422] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.292422] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.304301] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 937.306357] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.306357] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 937.335439] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.335627] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.335627] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.335819] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.337722] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.338048] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 937.338138] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 937.338219] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 937.366713] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.366713] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.366713] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.366946] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.367399] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.367554] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 937.400127] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.400224] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.400260] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.400449] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.400592] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.400989] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 937.437550] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.437725] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.437776] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.437977] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.438130] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.442021] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:10. [ 937.442021] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'50a60025-1a74-47a6-8a27-9b49e8f20582', 'a79f91b1-6637-404d-83b8-9a172d2bbf3b', '7f997137-cc0e-4d9a-be0a-b38c1cc3f73e', '1b546181-293b-47af-ad81-70b5a00fd2e3', '367b3953-c384-4a92-8d77-5aeea593412d', 'f9ef20af-ee9f-4f45-8eda-e9a89c8415d4', '1f9994a9-d5bc-4285-9c21-cc72e521d44e', 'ebe3ec3b-ff53-4ea3-bf1f-5938fc203196', '3334dcf0-49ba-4e8b-90d4-14df2863e5f2', 'be9ea5aa-5019-4bd3-86c8-7647a3bc317d'} {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 937.442021] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 937.458256] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.458412] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.458464] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.458679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.458765] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.458877] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 937.458972] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 937.459073] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 937.490691] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.490848] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.490909] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.492316] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.492592] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.492752] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 937.492824] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 937.492891] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 937.492954] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 937.493034] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 10/10 resources of Type:Security Group Rules [ 937.493102] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGH for action security_group_rules [ 937.493184] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGH for action security_group_rules [ 937.493235] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGH for action security_group_rules [ 937.493293] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGH for action security_group_rules [ 937.493349] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGH for action security_group_rules [ 937.493404] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGH for action security_group_rules [ 937.493461] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGH for action security_group_rules [ 937.493517] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGH for action security_group_rules [ 937.493574] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGH for action security_group_rules [ 937.493630] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGH for action security_group_rules [ 937.493696] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 937.493750] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 937.493938] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.494103] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.494172] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.494361] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.494439] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.494624] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.494722] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.494773] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.494939] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.495030] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.495147] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.495245] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.495301] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.495418] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.495487] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.495645] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.495731] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.495786] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.495929] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.495998] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.496168] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.496296] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.496351] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.496490] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.496560] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.496719] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.496805] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.496865] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.496988] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.497069] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.497247] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.497363] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.497419] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.497559] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.497630] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.497789] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.497868] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.497922] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.499928] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.499928] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.499928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.500381] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.500381] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.500381] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.500381] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.500381] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.500381] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 937.500381] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 937.500381] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 937.533574] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.533574] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.533719] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.533836] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.533969] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.534122] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 937.545621] env[69789]: INFO networking_nsxv3.common.synchronization [None req-58d8c784-afad-4329-a29f-0aee1105c282 None None] Enqueued Resource ID: d3971056-f0bc-4ab6-a288-e0a462c0a690 with Priority: HIGHEST for action port [ 937.545882] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3971056-f0bc-4ab6-a288-e0a462c0a690 with Priority: HIGHEST for action port [ 937.546036] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGH for action security_group_rules [ 937.546760] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGH for action security_group_rules [ 937.546760] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGH for action security_group_rules [ 937.546760] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGH for action security_group_rules [ 937.546760] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGH for action security_group_rules [ 937.546760] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGH for action security_group_rules [ 937.546760] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGH for action security_group_rules [ 937.546760] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGH for action security_group_rules [ 937.547046] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGH for action security_group_rules [ 937.547046] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGH for action security_group_rules [ 937.547515] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3971056-f0bc-4ab6-a288-e0a462c0a690 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.547633] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3971056-f0bc-4ab6-a288-e0a462c0a690" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.548254] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3971056-f0bc-4ab6-a288-e0a462c0a690" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.548254] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3971056-f0bc-4ab6-a288-e0a462c0a690" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.548254] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3971056-f0bc-4ab6-a288-e0a462c0a690',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.548895] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a60025-1a74-47a6-8a27-9b49e8f20582 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.549295] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.549295] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.549295] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.549453] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.550323] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.550431] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.550494] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.550645] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.550716] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.551404] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.551513] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.551579] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.551730] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.551800] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.552876] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.552991] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.553069] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.553222] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.553297] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.554213] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.554329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.554459] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.554547] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.554622] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.555608] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.555716] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.555784] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.556478] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.556478] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.556893] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.557353] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.557353] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.557353] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.557353] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.558154] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-367b3953-c384-4a92-8d77-5aeea593412d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.558268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.558314] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.558883] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.558883] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.559451] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.559601] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.559665] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.559776] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.559939] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.560658] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b546181-293b-47af-ad81-70b5a00fd2e3 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.560763] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.560828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.560978] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.561065] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.561297] env[69789]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 937.567418] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.567591] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.567651] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.567807] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.567919] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.586630] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.064889] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3971056-f0bc-4ab6-a288-e0a462c0a690 [ 938.065029] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.065167] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.065241] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.065435] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.065528] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.065621] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3971056-f0bc-4ab6-a288-e0a462c0a690 already deleted. [ 938.065699] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3971056-f0bc-4ab6-a288-e0a462c0a690" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.088528] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.088668] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.088904] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.089027] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.093913] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.094036] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.094101] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.094282] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.094431] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.094559] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.094624] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.094761] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.094842] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.094928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.095045] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.099716] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.099819] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.125018] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.125240] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.126445] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.126564] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.135992] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.136163] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.137031] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.137138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.137845] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.137967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.138677] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.138793] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e is going to be deleted. [ 938.140341] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.140507] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.140507] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.140675] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.142109] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.142239] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.159886] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.160088] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e is going to be deleted. [ 938.160931] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.161157] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.178618] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.178792] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 is going to be deleted. [ 938.180411] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.180636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.200890] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.201246] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.205310] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.205310] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 367b3953-c384-4a92-8d77-5aeea593412d is going to be deleted. [ 938.205821] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.205821] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.216799] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.216942] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.232624] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.232770] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 is going to be deleted. [ 938.234806] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.234806] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.263289] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.263289] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.265711] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.265862] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b is going to be deleted. [ 938.266806] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.267042] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.294044] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.294386] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 is going to be deleted. [ 938.295137] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.295357] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.359234] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.359371] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.360272] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.360400] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.397028] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.397834] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d is going to be deleted. [ 938.398147] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.398367] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.441095] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.441327] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.442179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.442302] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 is going to be deleted. [ 938.444418] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.444767] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.444767] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.444943] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.444999] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.445941] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.445941] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.445941] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.445941] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.446334] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.446334] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.446334] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.446445] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.446600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.446675] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.446785] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.446907] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.447062] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.447139] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.447257] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.447408] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.447555] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.447633] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.447739] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.526050] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.526196] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.526196] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.526421] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.526510] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.526628] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.527375] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.527496] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.527551] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.527701] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.527781] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.527884] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.599599] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.601327] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.601463] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.601528] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.601739] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.601831] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.601948] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.110089] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebe3ec3b-ff53-4ea3-bf1f-5938fc203196: rpc.has_security_group_logging(os_id): False [ 939.134090] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.134277] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.134444] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.134552] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.160443] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.160761] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.160878] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.160945] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.161185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.161281] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.161362] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 is going to be updated. [ 939.223827] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.224079] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.224079] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.224512] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.224705] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.238024] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 in Status: IN_PROGRESS for 2s [ 941.253780] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 in Status: SUCCESS [ 941.254049] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.548383] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 942.548693] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 947.378855] env[69789]: INFO networking_nsxv3.common.synchronization [req-08c4d868-7e90-416e-b005-09ae9f9f5cb0 req-bd00ae72-dbac-4053-887d-b7d9430ec40c tempest-ServersWithSpecificFlavorTestJSON-738434098 tempest-ServersWithSpecificFlavorTestJSON-738434098-project-member] Enqueued Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_members [ 947.379409] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGHEST for action security_group_members [ 947.379701] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.379823] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.379887] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.380118] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.380312] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.380436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.380495] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.380658] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.380735] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.380826] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.885928] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.886209] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.886304] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.886574] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.886698] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.886908] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.887016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.887077] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.887247] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.887349] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.887441] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 is going to be updated. [ 947.924168] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.924325] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.924377] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.924577] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.924711] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.935394] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 in Status: IN_PROGRESS for 2s [ 949.949436] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 in Status: SUCCESS [ 949.949853] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 deletion is rescheduled due to dependency. [ 949.949853] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.834019] env[69789]: INFO networking_nsxv3.common.synchronization [req-65c5a7fc-fd6d-4ddf-9dee-159a414e8928 req-0b607a89-d65e-4e50-8626-9744e3e82cbe tempest-DeleteServersTestJSON-938478453 tempest-DeleteServersTestJSON-938478453-project-member] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 950.834019] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 950.834019] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.834019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.834019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.834019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.834019] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.834019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.834019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.834019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.834019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.834019] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.338590] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.338590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.338590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.338590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.338590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.338590] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.338590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.338590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.338590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.338590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.338590] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 already deleted. [ 951.338590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.416251] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.416251] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.416251] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.416251] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.416251] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.416694] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.416694] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.417486] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.417486] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.417486] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.417486] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.417772] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.417772] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.417772] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.417885] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.417996] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.444391] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.444597] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 951.444720] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.444912] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.445263] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-640a621e-38ea-40b2-b71c-15fe3f0c1c42 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.445440] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-640a621e-38ea-40b2-b71c-15fe3f0c1c42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.445772] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-640a621e-38ea-40b2-b71c-15fe3f0c1c42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.446130] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-640a621e-38ea-40b2-b71c-15fe3f0c1c42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.446274] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('640a621e-38ea-40b2-b71c-15fe3f0c1c42',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.948688] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.948946] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.949132] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.949510] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.949678] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.949837] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 640a621e-38ea-40b2-b71c-15fe3f0c1c42 not found, creating... [ 951.950170] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.950315] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.950432] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.950701] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.950880] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.951209] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.951380] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.951494] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.951696] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.951832] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.951971] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 640a621e-38ea-40b2-b71c-15fe3f0c1c42 is going to be created. [ 951.978259] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.978482] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.978609] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.978900] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.979155] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.979388] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-640a621e-38ea-40b2-b71c-15fe3f0c1c42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.769359] env[69789]: INFO networking_nsxv3.common.synchronization [req-65c5a7fc-fd6d-4ddf-9dee-159a414e8928 req-dc59101a-ecda-41a0-8678-ff9414f3bc09 service nova] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_rules [ 952.769652] env[69789]: INFO networking_nsxv3.common.synchronization [req-65c5a7fc-fd6d-4ddf-9dee-159a414e8928 req-dc59101a-ecda-41a0-8678-ff9414f3bc09 service nova] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 952.769689] env[69789]: INFO networking_nsxv3.common.synchronization [req-65c5a7fc-fd6d-4ddf-9dee-159a414e8928 req-dc59101a-ecda-41a0-8678-ff9414f3bc09 service nova] Enqueued Resource ID: 640a621e-38ea-40b2-b71c-15fe3f0c1c42 with Priority: HIGHEST for action port [ 952.769887] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_rules [ 952.770033] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 952.770131] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 640a621e-38ea-40b2-b71c-15fe3f0c1c42 with Priority: HIGHEST for action port [ 952.770656] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.770786] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.770854] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.771528] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.771653] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.772667] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.772748] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.772801] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.772987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.773173] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.773291] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.773371] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.773540] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.773645] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.773756] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.777460] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-640a621e-38ea-40b2-b71c-15fe3f0c1c42 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.777591] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-640a621e-38ea-40b2-b71c-15fe3f0c1c42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.777681] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-640a621e-38ea-40b2-b71c-15fe3f0c1c42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.777828] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-640a621e-38ea-40b2-b71c-15fe3f0c1c42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.777984] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('640a621e-38ea-40b2-b71c-15fe3f0c1c42',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.901195] env[69789]: INFO networking_nsxv3.common.synchronization [req-4694b392-d571-4e7f-ae52-5fe5d1500d4d req-87114da2-f97b-4498-b26a-ccd8f1779fb8 tempest-ServersTestFqdnHostnames-265094891 tempest-ServersTestFqdnHostnames-265094891-project-member] Enqueued Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_members [ 952.901937] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_members [ 952.902255] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-03844cb4-294c-44e3-a590-26b53d6fb778 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.902390] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.902450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.902707] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.902865] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.902966] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.906108] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.906411] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.906535] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.906656] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.222918] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.223142] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-754" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.223266] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-754" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.223582] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-754" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.223843] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.223998] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.224137] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.224349] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.224494] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.224690] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.224801] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.224904] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.225017] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.225178] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.225230] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.225342] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.243367] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.243565] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 953.243755] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.243863] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-754" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.244188] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.244357] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.244479] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.244780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.244930] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76652ff3-72d0-410c-abd6-d0e0e4bfcdc7',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.279644] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.279808] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.279975] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.280826] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 640a621e-38ea-40b2-b71c-15fe3f0c1c42 with status ACTIVE [ 953.280947] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.281105] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.281160] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.281343] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.281433] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.281603] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.281696] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.281757] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.281898] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.281976] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.282169] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.282264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.282324] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.282462] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.282537] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.282621] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 640a621e-38ea-40b2-b71c-15fe3f0c1c42 is going to be updated. [ 953.305373] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.305487] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.305556] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.305779] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.305919] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.306096] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-640a621e-38ea-40b2-b71c-15fe3f0c1c42" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.410653] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.410847] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.410889] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.411127] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.411220] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.411412] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.411512] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.411574] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.411727] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.411804] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.411884] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03844cb4-294c-44e3-a590-26b53d6fb778 already deleted. [ 953.411965] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.746939] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.747195] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.747322] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.747663] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.747822] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.747979] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 76652ff3-72d0-410c-abd6-d0e0e4bfcdc7 not found, creating... [ 953.748284] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.748445] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.748565] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.748801] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.748933] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.749217] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.749371] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.749487] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.749692] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.749827] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.749963] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 76652ff3-72d0-410c-abd6-d0e0e4bfcdc7 is going to be created. [ 953.769769] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.770153] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.770153] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.770452] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.770703] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.770932] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.785592] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.289170] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.289406] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.289464] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.289681] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.289793] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.289907] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be created. [ 954.315655] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.315826] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.315915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.316193] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.316426] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.326152] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: UNINITIALIZED for 2s [ 954.466629] env[69789]: INFO networking_nsxv3.common.synchronization [req-4694b392-d571-4e7f-ae52-5fe5d1500d4d req-c5655ddf-9348-42df-bc10-3e6ecc6d3696 service nova] Enqueued Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_rules [ 954.466807] env[69789]: INFO networking_nsxv3.common.synchronization [req-4694b392-d571-4e7f-ae52-5fe5d1500d4d req-c5655ddf-9348-42df-bc10-3e6ecc6d3696 service nova] Enqueued Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_members [ 954.466977] env[69789]: INFO networking_nsxv3.common.synchronization [req-4694b392-d571-4e7f-ae52-5fe5d1500d4d req-c5655ddf-9348-42df-bc10-3e6ecc6d3696 service nova] Enqueued Resource ID: 76652ff3-72d0-410c-abd6-d0e0e4bfcdc7 with Priority: HIGHEST for action port [ 954.467178] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_rules [ 954.467306] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_members [ 954.467399] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76652ff3-72d0-410c-abd6-d0e0e4bfcdc7 with Priority: HIGHEST for action port [ 954.469998] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03844cb4-294c-44e3-a590-26b53d6fb778 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.470189] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.470257] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.470472] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.472021] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.472021] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-03844cb4-294c-44e3-a590-26b53d6fb778 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.472021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.472021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.472228] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.472364] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.473370] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.475212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.475212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.475212] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.475212] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.475583] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.475583] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.475583] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.475583] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.475762] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76652ff3-72d0-410c-abd6-d0e0e4bfcdc7',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.977402] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-03844cb4-294c-44e3-a590-26b53d6fb778 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.978217] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.978217] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76652ff3-72d0-410c-abd6-d0e0e4bfcdc7 with status ACTIVE [ 954.978217] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.978217] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.978217] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.978724] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.978724] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.978724] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.978724] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.978724] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.978934] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.978934] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.979160] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.979258] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.979317] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.979460] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.979534] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.979617] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76652ff3-72d0-410c-abd6-d0e0e4bfcdc7 is going to be updated. [ 954.980701] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.003270] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.003443] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.003443] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.003657] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.003796] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.003953] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76652ff3-72d0-410c-abd6-d0e0e4bfcdc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.177882] env[69789]: INFO networking_nsxv3.common.synchronization [req-c26795ec-f411-4ce7-a5ff-b1ac0942c275 req-0eab47a8-dfb5-43d5-bdf8-2ac7f34c31e8 tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_members [ 955.178458] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_members [ 955.178784] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.178920] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.178990] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.179270] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.179436] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.179542] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.179606] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.179765] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.179854] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.179949] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.483516] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.683914] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.684109] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.684179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.684419] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.684534] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.684814] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.684975] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.685096] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.685303] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.685396] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.685518] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 already deleted. [ 955.685647] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.704190] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-748 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.704460] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-748" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.704534] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-748" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.704957] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-748" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.705134] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.705294] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.705414] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.705634] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.705780] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.705983] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.706109] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.706222] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.706328] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.706482] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.706592] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.706723] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.724135] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.724329] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 955.724479] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.724662] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-748" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.724971] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-84c5a39e-6ab2-4353-8648-eb3fc939be20 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.725165] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-84c5a39e-6ab2-4353-8648-eb3fc939be20" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.725284] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-84c5a39e-6ab2-4353-8648-eb3fc939be20" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.725896] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-84c5a39e-6ab2-4353-8648-eb3fc939be20" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.725896] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84c5a39e-6ab2-4353-8648-eb3fc939be20',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.987968] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.988346] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.988346] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.988486] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.988611] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.988740] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03844cb4-294c-44e3-a590-26b53d6fb778 is going to be created. [ 956.010984] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.011189] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.011265] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.011527] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.011720] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.020876] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03844cb4-294c-44e3-a590-26b53d6fb778 in Status: UNINITIALIZED for 2s [ 956.228813] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.229089] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.229206] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.229523] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.229689] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.229848] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 84c5a39e-6ab2-4353-8648-eb3fc939be20 not found, creating... [ 956.230139] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.230302] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.230438] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.230674] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.230816] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.231111] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.231301] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.231416] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.231606] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.231738] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.231878] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 84c5a39e-6ab2-4353-8648-eb3fc939be20 is going to be created. [ 956.252416] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.252624] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.252750] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.253031] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.253261] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.253504] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-84c5a39e-6ab2-4353-8648-eb3fc939be20" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.336270] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 956.336554] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.336793] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.336904] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.337106] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.337231] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.337294] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.337449] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.337566] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.337684] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.337776] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.840423] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.841191] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.841191] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.841191] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.841191] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.841191] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.841472] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.841472] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.841540] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.841575] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.842045] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.842045] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.842045] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.842045] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.842243] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.842288] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.842324] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.843067] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.843067] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.843067] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.843067] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.955100] env[69789]: INFO networking_nsxv3.common.synchronization [req-c26795ec-f411-4ce7-a5ff-b1ac0942c275 req-acd6eef0-c23d-481c-8eab-b29487022743 service nova] Enqueued Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_rules [ 956.955387] env[69789]: INFO networking_nsxv3.common.synchronization [req-c26795ec-f411-4ce7-a5ff-b1ac0942c275 req-acd6eef0-c23d-481c-8eab-b29487022743 service nova] Enqueued Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_members [ 956.955588] env[69789]: INFO networking_nsxv3.common.synchronization [req-c26795ec-f411-4ce7-a5ff-b1ac0942c275 req-acd6eef0-c23d-481c-8eab-b29487022743 service nova] Enqueued Resource ID: 84c5a39e-6ab2-4353-8648-eb3fc939be20 with Priority: HIGHEST for action port [ 956.958154] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_rules [ 956.958439] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_members [ 956.959075] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84c5a39e-6ab2-4353-8648-eb3fc939be20 with Priority: HIGHEST for action port [ 956.959075] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.959075] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.959352] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.959450] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.959558] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.960528] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.960661] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.960863] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.960942] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.961291] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.961291] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.961291] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.961468] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.961468] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.961537] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.964408] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-84c5a39e-6ab2-4353-8648-eb3fc939be20 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.964408] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84c5a39e-6ab2-4353-8648-eb3fc939be20" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.964408] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84c5a39e-6ab2-4353-8648-eb3fc939be20" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.964408] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84c5a39e-6ab2-4353-8648-eb3fc939be20" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.964408] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84c5a39e-6ab2-4353-8648-eb3fc939be20',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.345474] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6: rpc.has_security_group_logging(os_id): False [ 957.363102] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.363269] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.363373] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.363551] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.363643] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.363853] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.363948] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.364017] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.364169] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.364245] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.364455] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.364579] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.364639] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.364791] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.364868] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.365072] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.365168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.365231] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.365414] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.365494] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.365580] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be created. [ 957.421378] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.421378] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.421378] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.421672] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.421714] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.433606] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 957.464481] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.464481] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.464757] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.465742] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84c5a39e-6ab2-4353-8648-eb3fc939be20 with status ACTIVE [ 957.465932] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.466055] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.466123] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.467772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.467772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.467772] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.467772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.467772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.467772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.467772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.467772] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.467772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.467772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.468573] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.468573] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.468573] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84c5a39e-6ab2-4353-8648-eb3fc939be20 is going to be updated. [ 957.498924] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.499102] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.499167] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.499347] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.499672] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.499802] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84c5a39e-6ab2-4353-8648-eb3fc939be20" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.521958] env[69789]: INFO networking_nsxv3.common.synchronization [req-aab27543-c4b6-4a87-b425-6f9db65937b1 req-f1e2e377-2447-4237-bc5a-efb104665c85 tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 957.522535] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 957.522857] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.523013] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.523487] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.523771] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.523957] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.524096] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.524164] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.524355] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.524534] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.524638] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.837791] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.837791] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-839" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.838205] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-839" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.838205] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-839" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.838412] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.838573] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.838693] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.839077] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.839240] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.839454] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.839596] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.839682] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.839791] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.839901] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.840016] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.840160] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.859692] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.859916] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.860075] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.860294] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-839" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.860609] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-a447dcfd-590e-4909-adfb-d7b2edf8b91d taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.860785] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.860908] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.861246] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.861385] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a447dcfd-590e-4909-adfb-d7b2edf8b91d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.969850] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.028289] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.029138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.029138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.029138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.029138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.029138] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.029380] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.029380] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.029601] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.029716] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.029809] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 already deleted. [ 958.029897] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.031308] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03844cb4-294c-44e3-a590-26b53d6fb778 in Status: SUCCESS [ 958.031308] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.031626] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.031626] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.031801] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.031864] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.031916] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.032080] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.032161] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.032329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.032329] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.366655] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.367222] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.367222] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.367414] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.367617] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.367758] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port a447dcfd-590e-4909-adfb-d7b2edf8b91d not found, creating... [ 958.368048] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.368248] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.368375] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.368865] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.369089] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.369393] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.369561] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.369671] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.369890] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.370035] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.370181] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d is going to be created. [ 958.392696] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.392971] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.393117] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.393385] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.393654] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.393863] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.472819] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.473090] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.473090] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.473333] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.473441] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.473560] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 is going to be created. [ 958.511700] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.511912] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.511963] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.512199] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.512383] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.522808] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 in Status: UNINITIALIZED for 2s [ 958.534367] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.037139] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03844cb4-294c-44e3-a590-26b53d6fb778: rpc.has_security_group_logging(os_id): False [ 959.056222] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.056431] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.056507] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.058046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.058046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.058046] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.058046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.058046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.058046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.058046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.058046] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03844cb4-294c-44e3-a590-26b53d6fb778 is going to be created. [ 959.099474] env[69789]: INFO networking_nsxv3.common.synchronization [req-aab27543-c4b6-4a87-b425-6f9db65937b1 req-2d03cc1b-d618-4130-928d-36e86c591c84 service nova] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_rules [ 959.099686] env[69789]: INFO networking_nsxv3.common.synchronization [req-aab27543-c4b6-4a87-b425-6f9db65937b1 req-2d03cc1b-d618-4130-928d-36e86c591c84 service nova] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 959.099833] env[69789]: INFO networking_nsxv3.common.synchronization [req-aab27543-c4b6-4a87-b425-6f9db65937b1 req-2d03cc1b-d618-4130-928d-36e86c591c84 service nova] Enqueued Resource ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d with Priority: HIGHEST for action port [ 959.100361] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_rules [ 959.100508] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 959.100586] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d with Priority: HIGHEST for action port [ 959.100857] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.100986] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.101064] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.101313] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.101679] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.102253] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.102369] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.102436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.102603] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.102746] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.102840] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.102902] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.103071] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.103160] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.103252] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.105239] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-a447dcfd-590e-4909-adfb-d7b2edf8b91d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.105350] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.105350] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.105494] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.105571] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a447dcfd-590e-4909-adfb-d7b2edf8b91d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.124219] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.124473] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.124473] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.124640] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.124824] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.141671] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03844cb4-294c-44e3-a590-26b53d6fb778 in Status: IN_PROGRESS for 2s [ 959.446448] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 959.446953] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.606106] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.607273] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.607409] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.607563] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a447dcfd-590e-4909-adfb-d7b2edf8b91d with status ACTIVE [ 959.607750] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.607864] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.607928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.608166] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.608256] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.608435] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.608535] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.608598] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.608759] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.608835] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.609022] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.613220] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.613292] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.613465] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.613538] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.613631] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d is going to be updated. [ 959.638650] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.638861] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.638910] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.639122] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.639260] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.639415] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.116041] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.545196] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 in Status: SUCCESS [ 960.545531] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.545571] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.545795] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.546053] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.546198] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.546296] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.546620] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.546732] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.546834] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.546934] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.618846] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.619168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.619254] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.619471] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.619618] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.619778] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 is going to be created. [ 960.646808] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.647061] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.647061] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.647264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.647431] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.659331] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: UNINITIALIZED for 2s [ 961.050922] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.157969] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03844cb4-294c-44e3-a590-26b53d6fb778 in Status: SUCCESS [ 961.158210] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.553723] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fa29281-8c2a-46fb-8fd2-9726f1c3e301: rpc.has_security_group_logging(os_id): False [ 961.573290] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.573475] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.573475] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.573648] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.573740] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.573970] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.574090] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.574154] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.574395] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.574543] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.574692] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 is going to be created. [ 961.632519] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.632657] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.632734] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.632945] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.633141] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.647238] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 in Status: IN_PROGRESS for 2s [ 962.670251] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: SUCCESS [ 962.670251] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.670750] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.670750] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.670961] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.671155] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.671257] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.671509] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.671663] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.671803] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.671958] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.174577] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.174718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.174784] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.175018] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.175214] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.175314] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.175383] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.175532] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.175622] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.175711] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.175896] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.175996] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.176069] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.176215] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.176349] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.176518] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.176619] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.180097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.180097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.180097] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.180097] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.660930] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 in Status: SUCCESS [ 963.660930] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.680753] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b1c52a2-60db-49fd-a602-b61067002333: rpc.has_security_group_logging(os_id): False [ 963.701695] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.701695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.701695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.701695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.701695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.701695] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.701695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.701695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.701695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.702075] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.702075] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.702075] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.702075] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.702299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.702299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.702455] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.702549] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.702608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.702773] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.702807] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.702895] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 is going to be created. [ 963.758225] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.758345] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.758412] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.758629] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.758865] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.769406] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: IN_PROGRESS for 2s [ 964.101829] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 964.102043] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 965.782974] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: SUCCESS [ 965.783283] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.103023] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 969.103299] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 974.104074] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 974.104422] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 975.605366] env[69789]: INFO networking_nsxv3.common.synchronization [None req-2fd8bb9d-d8cc-4d57-ba42-73304d304e44 None None] Enqueued Resource ID: 13da1e8d-75b2-4414-870f-6abe909ecb09 with Priority: HIGHEST for action port [ 975.605968] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13da1e8d-75b2-4414-870f-6abe909ecb09 with Priority: HIGHEST for action port [ 975.607601] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-13da1e8d-75b2-4414-870f-6abe909ecb09 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.607601] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13da1e8d-75b2-4414-870f-6abe909ecb09" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.607601] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13da1e8d-75b2-4414-870f-6abe909ecb09" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.607951] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13da1e8d-75b2-4414-870f-6abe909ecb09" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.607951] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13da1e8d-75b2-4414-870f-6abe909ecb09',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.110306] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13da1e8d-75b2-4414-870f-6abe909ecb09 [ 976.110583] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.110723] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.110793] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.110996] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.111104] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.111202] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13da1e8d-75b2-4414-870f-6abe909ecb09 already deleted. [ 976.111287] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13da1e8d-75b2-4414-870f-6abe909ecb09" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.225290] env[69789]: INFO networking_nsxv3.common.synchronization [req-839f9a96-7f4d-42c2-9daa-ad96e05833bd req-c9ee9c15-1fe2-4b98-8727-0f946d92f2a6 tempest-DeleteServersTestJSON-938478453 tempest-DeleteServersTestJSON-938478453-project-member] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 976.225468] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 976.225776] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.225956] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.226767] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.226767] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.226866] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.226919] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.226944] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.227138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.227229] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.227324] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.431293] env[69789]: INFO networking_nsxv3.common.synchronization [req-b41c205a-dfb8-47cd-b1a6-aecc49d735a1 req-59ed04e2-8216-463f-8522-7bca39e2e1fb tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 976.431293] env[69789]: INFO networking_nsxv3.common.synchronization [req-b41c205a-dfb8-47cd-b1a6-aecc49d735a1 req-59ed04e2-8216-463f-8522-7bca39e2e1fb tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 with Priority: HIGHEST for action security_group_members [ 976.431487] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 976.431648] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 with Priority: HIGHEST for action security_group_members [ 976.433788] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.433923] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.433991] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.434238] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.434407] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.434649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.434649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.434874] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.434914] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.435025] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.436145] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.439040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.439040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.439040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.439040] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.439040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.439040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.439040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.439040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.439040] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8a5298b-705c-4b5d-9cb4-f5b482ac42d6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.546212] env[69789]: INFO networking_nsxv3.common.synchronization [req-b41c205a-dfb8-47cd-b1a6-aecc49d735a1 req-59ed04e2-8216-463f-8522-7bca39e2e1fb tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_rules [ 976.546472] env[69789]: INFO networking_nsxv3.common.synchronization [req-b41c205a-dfb8-47cd-b1a6-aecc49d735a1 req-59ed04e2-8216-463f-8522-7bca39e2e1fb tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 976.546535] env[69789]: INFO networking_nsxv3.common.synchronization [req-b41c205a-dfb8-47cd-b1a6-aecc49d735a1 req-59ed04e2-8216-463f-8522-7bca39e2e1fb tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 with Priority: HIGHEST for action security_group_rules [ 976.546694] env[69789]: INFO networking_nsxv3.common.synchronization [req-b41c205a-dfb8-47cd-b1a6-aecc49d735a1 req-59ed04e2-8216-463f-8522-7bca39e2e1fb tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 with Priority: HIGHEST for action security_group_members [ 976.546832] env[69789]: INFO networking_nsxv3.common.synchronization [req-b41c205a-dfb8-47cd-b1a6-aecc49d735a1 req-59ed04e2-8216-463f-8522-7bca39e2e1fb tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d with Priority: HIGHEST for action port [ 976.547493] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_rules [ 976.547763] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 with Priority: HIGHEST for action security_group_rules [ 976.547763] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d with Priority: HIGHEST for action port [ 976.547855] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 976.547923] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 with Priority: HIGHEST for action security_group_members [ 976.548209] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.548385] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.548385] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.549269] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.549269] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.549540] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.550112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.550112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.550112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.550112] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8a5298b-705c-4b5d-9cb4-f5b482ac42d6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.552436] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-a447dcfd-590e-4909-adfb-d7b2edf8b91d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.552436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.552436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.552436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.552436] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a447dcfd-590e-4909-adfb-d7b2edf8b91d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.553408] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.553408] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.554091] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.554091] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.733190] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.733190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.733190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.733190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.733190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.733190] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.733190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.733190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.733190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.733190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.733190] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 976.761376] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.761735] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.761885] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.762178] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.762394] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.770913] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 976.941229] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.941229] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8a5298b-705c-4b5d-9cb4-f5b482ac42d6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.058021] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.058021] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.058021] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a447dcfd-590e-4909-adfb-d7b2edf8b91d with status ACTIVE [ 977.058021] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.058021] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.058021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.058876] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.058876] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.064294] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.064294] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.064294] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.064294] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d is going to be updated. [ 977.090338] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.090338] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.090338] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.090338] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.090338] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.090338] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.148895] env[69789]: INFO networking_nsxv3.common.synchronization [req-aa4c7e9b-e9d4-4856-a0f9-0f3df0c0ad5e req-a9ea9590-229d-40ca-b50d-d0e5397eda7e tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 977.149099] env[69789]: INFO networking_nsxv3.common.synchronization [req-aa4c7e9b-e9d4-4856-a0f9-0f3df0c0ad5e req-a9ea9590-229d-40ca-b50d-d0e5397eda7e tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 with Priority: HIGHEST for action security_group_members [ 977.149730] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 977.149876] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 with Priority: HIGHEST for action security_group_members [ 977.151076] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.151274] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.151717] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.151953] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.266108] env[69789]: INFO networking_nsxv3.common.synchronization [req-aa4c7e9b-e9d4-4856-a0f9-0f3df0c0ad5e req-a9ea9590-229d-40ca-b50d-d0e5397eda7e tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_rules [ 977.271316] env[69789]: INFO networking_nsxv3.common.synchronization [req-aa4c7e9b-e9d4-4856-a0f9-0f3df0c0ad5e req-a9ea9590-229d-40ca-b50d-d0e5397eda7e tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 977.271316] env[69789]: INFO networking_nsxv3.common.synchronization [req-aa4c7e9b-e9d4-4856-a0f9-0f3df0c0ad5e req-a9ea9590-229d-40ca-b50d-d0e5397eda7e tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d with Priority: HIGHEST for action port [ 977.274303] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_rules [ 977.274303] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 977.274303] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d with Priority: HIGHEST for action port [ 977.274303] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.274303] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.274303] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.274303] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.274303] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-a447dcfd-590e-4909-adfb-d7b2edf8b91d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.274303] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.274303] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.274303] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.274303] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a447dcfd-590e-4909-adfb-d7b2edf8b91d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.442660] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.443783] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8a5298b-705c-4b5d-9cb4-f5b482ac42d6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.776841] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a447dcfd-590e-4909-adfb-d7b2edf8b91d with status ACTIVE [ 977.777101] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.777300] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.779018] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.779018] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.779018] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.779151] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.779265] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.779332] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.779489] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.779569] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.779749] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.779871] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.779953] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.780088] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.780164] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.780285] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a447dcfd-590e-4909-adfb-d7b2edf8b91d is going to be updated. [ 977.811681] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.811846] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.811933] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.812641] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.812641] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.812779] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a447dcfd-590e-4909-adfb-d7b2edf8b91d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.948523] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.948523] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.948523] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.948523] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.948523] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.948523] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 is going to be updated. [ 977.948523] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.948523] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.948523] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.948523] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.948523] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.948523] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 is going to be created. [ 977.976097] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.976459] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.976545] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.976808] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.977013] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.979174] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.979432] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.979432] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.979676] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.979813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.997515] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: IN_PROGRESS for 2s [ 978.000592] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 in Status: UNINITIALIZED for 2s [ 978.072870] env[69789]: INFO networking_nsxv3.common.synchronization [None req-3d14d208-eac0-431b-9edb-380d3667519d None None] Enqueued Resource ID: 69ff7f4c-7ef1-4c79-bc62-147407a85f2f with Priority: HIGHEST for action port [ 978.073670] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ff7f4c-7ef1-4c79-bc62-147407a85f2f with Priority: HIGHEST for action port [ 978.073670] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-69ff7f4c-7ef1-4c79-bc62-147407a85f2f taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.073801] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69ff7f4c-7ef1-4c79-bc62-147407a85f2f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.073835] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69ff7f4c-7ef1-4c79-bc62-147407a85f2f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.074206] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69ff7f4c-7ef1-4c79-bc62-147407a85f2f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.074306] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69ff7f4c-7ef1-4c79-bc62-147407a85f2f',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.576679] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69ff7f4c-7ef1-4c79-bc62-147407a85f2f [ 978.576918] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.577091] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.577164] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.577394] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.577500] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.577612] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69ff7f4c-7ef1-4c79-bc62-147407a85f2f already deleted. [ 978.577709] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69ff7f4c-7ef1-4c79-bc62-147407a85f2f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.781058] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 978.781360] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 deletion is rescheduled due to dependency. [ 978.781360] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.017882] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 in Status: SUCCESS [ 980.018331] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.018331] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.018677] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.018742] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.018983] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.019077] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.019227] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.019312] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.019408] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8a5298b-705c-4b5d-9cb4-f5b482ac42d6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.020957] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: SUCCESS [ 980.021215] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.021383] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.021560] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.021834] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.021834] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.021959] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.023367] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.023367] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.023367] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.524580] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.524741] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.524812] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.525104] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.525251] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.525379] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.525483] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.525539] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.525704] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.525782] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.525870] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 is going to be deleted. [ 980.527304] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.564918] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.565167] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.565267] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.565586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.565715] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.565908] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.566138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.566367] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.566749] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.566855] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.566973] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.567206] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.567335] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.567481] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8a5298b-705c-4b5d-9cb4-f5b482ac42d6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.029462] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.069760] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.069951] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.070040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.070296] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.070397] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.070634] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.070732] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.070798] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.070973] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.071067] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.071172] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 already deleted. [ 981.071255] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.071363] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8a5298b-705c-4b5d-9cb4-f5b482ac42d6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.072285] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.072484] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.075508] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.075508] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.075508] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.075508] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.075508] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.075508] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8a5298b-705c-4b5d-9cb4-f5b482ac42d6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.531535] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.531718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.531902] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.532102] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.532205] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.532309] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 is going to be updated. [ 981.561906] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.562070] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.562143] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.563717] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.563878] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.573340] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: IN_PROGRESS for 2s [ 981.577253] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8a5298b-705c-4b5d-9cb4-f5b482ac42d6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.577918] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.577918] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.577918] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.578124] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.578211] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.578400] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.578495] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.578549] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.578732] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.578843] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.578967] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 already deleted. [ 981.579072] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.017748] env[69789]: INFO networking_nsxv3.common.synchronization [None req-081ae2d4-cebf-45e2-a817-d40f01885570 None None] Enqueued Resource ID: 32b23f23-c82b-4722-8653-854673233e4b with Priority: HIGHEST for action port [ 982.018322] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b23f23-c82b-4722-8653-854673233e4b with Priority: HIGHEST for action port [ 982.018641] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-32b23f23-c82b-4722-8653-854673233e4b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.018772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32b23f23-c82b-4722-8653-854673233e4b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.018841] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32b23f23-c82b-4722-8653-854673233e4b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.019589] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32b23f23-c82b-4722-8653-854673233e4b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.019753] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32b23f23-c82b-4722-8653-854673233e4b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.080426] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8a5298b-705c-4b5d-9cb4-f5b482ac42d6: rpc.has_security_group_logging(os_id): False [ 982.099013] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.099158] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.099236] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.099449] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.099544] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.099721] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.099819] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.099895] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.100019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.100096] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.100192] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 is going to be created. [ 982.118549] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/b8a5298b-705c-4b5d-9cb4-f5b482ac42d6], does not exist path=[/infra/domains/default/groups/b8a5298b-705c-4b5d-9cb4-f5b482ac42d6]."\n}' [ 982.118695] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 [ 982.118784] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 982.146252] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.146438] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.146515] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.146930] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.147357] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.147608] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.147742] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.147810] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.147982] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.148075] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.148249] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.148345] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.148404] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.148545] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.148619] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.148704] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 is going to be created. [ 982.174169] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/b8a5298b-705c-4b5d-9cb4-f5b482ac42d6], does not exist path=[/infra/domains/default/groups/b8a5298b-705c-4b5d-9cb4-f5b482ac42d6]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 [ 982.174358] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8a5298b-705c-4b5d-9cb4-f5b482ac42d6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.174981] env[69789]: Traceback (most recent call last): [ 982.175136] env[69789]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 982.175136] env[69789]: return func(*args, **kwargs) [ 982.175136] env[69789]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 982.175136] env[69789]: res.raise_for_status() [ 982.175136] env[69789]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 982.175136] env[69789]: raise HTTPError(http_error_msg, response=self) [ 982.175136] env[69789]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 [ 982.175136] env[69789]: During handling of the above exception, another exception occurred: [ 982.175136] env[69789]: Traceback (most recent call last): [ 982.175136] env[69789]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 982.175136] env[69789]: listener.cb(fileno) [ 982.175136] env[69789]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 982.175136] env[69789]: result = function(*args, **kwargs) [ 982.175136] env[69789]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 982.175136] env[69789]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 982.175136] env[69789]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 982.175136] env[69789]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 982.175136] env[69789]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 982.175136] env[69789]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 982.175136] env[69789]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 982.175136] env[69789]: res.raise_for_status() [ 982.175136] env[69789]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 982.175136] env[69789]: raise HTTPError(http_error_msg, response=self) [ 982.175136] env[69789]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b8a5298b-705c-4b5d-9cb4-f5b482ac42d6 [ 982.175136] env[69789]: Removing descriptor: 15 [ 982.524608] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32b23f23-c82b-4722-8653-854673233e4b [ 982.524608] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.524608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.524608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.524608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.524608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.524608] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32b23f23-c82b-4722-8653-854673233e4b already deleted. [ 982.524608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32b23f23-c82b-4722-8653-854673233e4b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.295208] env[69789]: INFO networking_nsxv3.common.synchronization [req-c90887db-f8ef-4d34-9794-4801f13ee2c7 req-4a67c178-6347-47e0-89dd-9829bf8d957b tempest-ServerRescueTestJSONUnderV235-1689322081 tempest-ServerRescueTestJSONUnderV235-1689322081-project-member] Enqueued Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 983.295751] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c52a2-60db-49fd-a602-b61067002333 with Priority: HIGHEST for action security_group_members [ 983.296079] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.296188] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.584572] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: SUCCESS [ 983.584572] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.584727] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.584855] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.586050] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.586050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.586050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.586050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.586050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.586050] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.586050] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.586575] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.586774] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.586922] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.587426] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.587576] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.587786] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.587917] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.588068] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.002150] env[69789]: INFO networking_nsxv3.common.synchronization [None req-36102585-9858-4e58-ab5d-22223dc642f1 None None] Enqueued Resource ID: 29099de4-d7a5-444b-bd05-e501cdcaee14 with Priority: HIGHEST for action port [ 984.002674] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29099de4-d7a5-444b-bd05-e501cdcaee14 with Priority: HIGHEST for action port [ 984.003033] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-29099de4-d7a5-444b-bd05-e501cdcaee14 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.007600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29099de4-d7a5-444b-bd05-e501cdcaee14" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.007600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29099de4-d7a5-444b-bd05-e501cdcaee14" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.007600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29099de4-d7a5-444b-bd05-e501cdcaee14" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.007600] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29099de4-d7a5-444b-bd05-e501cdcaee14',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.089614] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.089860] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.090065] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.090189] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.090256] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.090490] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.110935] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.111230] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.111375] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.111453] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.111682] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.111773] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.111866] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 is going to be updated. [ 984.137116] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.137347] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.137347] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.137547] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.137713] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.146095] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: IN_PROGRESS for 2s [ 984.511798] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29099de4-d7a5-444b-bd05-e501cdcaee14 [ 984.512109] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.512183] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.512279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.512461] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.512548] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.512644] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29099de4-d7a5-444b-bd05-e501cdcaee14 already deleted. [ 984.512723] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29099de4-d7a5-444b-bd05-e501cdcaee14" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.157335] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: SUCCESS [ 986.157629] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 deletion is rescheduled due to dependency. [ 986.157692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.157890] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.158621] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.158621] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.158621] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.158621] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.158621] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.158867] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.158867] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.661464] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.661641] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.661715] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.661941] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.662059] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.662256] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.662355] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.662417] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.662569] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.662645] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.662728] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 is going to be updated. [ 986.689863] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.690068] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.690134] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.690288] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.690424] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.699455] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: IN_PROGRESS for 2s [ 988.713366] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: SUCCESS [ 988.713702] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 deletion is rescheduled due to dependency. [ 988.713702] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.713824] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.714060] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.714243] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.714363] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.714428] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.714615] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.714777] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.714882] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.004187] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 989.004344] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 989.217527] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.217628] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.217667] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.217913] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.218027] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.218237] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.218341] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.218403] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.218555] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.218634] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.218732] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 is going to be updated. [ 989.246725] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.246915] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.246978] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.247192] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.247336] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.256114] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: IN_PROGRESS for 2s [ 991.267424] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: SUCCESS [ 991.267809] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 deletion is rescheduled due to dependency. [ 991.267809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.267939] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.268126] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.268310] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.268429] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.268497] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.268649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.268748] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.268838] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.269078] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1c52a2-60db-49fd-a602-b61067002333 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.269222] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.269292] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.269440] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.269602] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.269697] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.269798] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.269897] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.269993] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.270061] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.270149] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.773312] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b1c52a2-60db-49fd-a602-b61067002333: rpc.has_security_group_logging(os_id): False [ 991.795330] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.795606] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.795691] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.795911] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.796012] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.796212] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.796308] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.796362] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.796525] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.796601] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.796828] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.796936] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.797013] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.797157] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.797235] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.797436] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.797528] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.797591] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.797736] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.797821] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.798216] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 is going to be updated. [ 991.858726] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.858866] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.858943] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.859492] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.859492] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.874672] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: IN_PROGRESS for 2s [ 993.891519] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b1c52a2-60db-49fd-a602-b61067002333 in Status: SUCCESS [ 993.891519] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.891921] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.891921] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.891921] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b1c52a2-60db-49fd-a602-b61067002333',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.005876] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 994.006066] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 994.411461] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.411693] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.411693] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.411887] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.411980] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.412097] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b1c52a2-60db-49fd-a602-b61067002333 is going to be deleted. [ 994.459654] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.459846] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.459846] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.460081] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.460174] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.460297] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b1c52a2-60db-49fd-a602-b61067002333" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.007481] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 999.007833] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1002.051554] env[69789]: INFO networking_nsxv3.common.synchronization [req-6a2bd0a5-dab6-4f6e-a2b6-ac18f2bb2d98 req-38299ba2-2656-4e07-bb33-bf880bdda753 tempest-ServersTestFqdnHostnames-265094891 tempest-ServersTestFqdnHostnames-265094891-project-member] Enqueued Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_members [ 1002.052095] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGHEST for action security_group_members [ 1002.052386] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-03844cb4-294c-44e3-a590-26b53d6fb778 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.052508] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.052583] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.053200] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.053200] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.053356] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.053356] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.053751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.053751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.053751] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.558129] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.558331] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.558331] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.558559] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.578334] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.578570] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.578690] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.578758] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.578954] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.579052] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.579149] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03844cb4-294c-44e3-a590-26b53d6fb778 is going to be updated. [ 1002.604018] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.604221] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.604267] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.604456] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.604589] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.612686] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03844cb4-294c-44e3-a590-26b53d6fb778 in Status: IN_PROGRESS for 2s [ 1004.623993] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03844cb4-294c-44e3-a590-26b53d6fb778 in Status: SUCCESS [ 1004.623993] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03844cb4-294c-44e3-a590-26b53d6fb778 deletion is rescheduled due to dependency. [ 1004.623993] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.053089] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1007.053347] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1009.216068] env[69789]: INFO networking_nsxv3.common.synchronization [None req-bd471d87-46de-48b7-9f63-0211b4e314fa None None] Enqueued Resource ID: 10fc88b2-165e-4c1c-8b84-ca9e3eb55192 with Priority: HIGHEST for action port [ 1009.216330] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10fc88b2-165e-4c1c-8b84-ca9e3eb55192 with Priority: HIGHEST for action port [ 1009.216789] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-10fc88b2-165e-4c1c-8b84-ca9e3eb55192 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.216998] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10fc88b2-165e-4c1c-8b84-ca9e3eb55192" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.216998] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10fc88b2-165e-4c1c-8b84-ca9e3eb55192" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.217282] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10fc88b2-165e-4c1c-8b84-ca9e3eb55192" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.217393] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10fc88b2-165e-4c1c-8b84-ca9e3eb55192',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.721014] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10fc88b2-165e-4c1c-8b84-ca9e3eb55192 [ 1009.721014] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.721014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.721014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.721014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.721014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.721014] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10fc88b2-165e-4c1c-8b84-ca9e3eb55192 already deleted. [ 1009.721014] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10fc88b2-165e-4c1c-8b84-ca9e3eb55192" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.788797] env[69789]: INFO networking_nsxv3.common.synchronization [None req-178e2c70-23ad-4392-bf24-4f31bbbee794 None None] Enqueued Resource ID: 40b9cb25-ef0e-49fc-a61a-afb224e8d30b with Priority: HIGHEST for action port [ 1010.789326] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b9cb25-ef0e-49fc-a61a-afb224e8d30b with Priority: HIGHEST for action port [ 1010.789623] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-40b9cb25-ef0e-49fc-a61a-afb224e8d30b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.789746] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40b9cb25-ef0e-49fc-a61a-afb224e8d30b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.789815] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40b9cb25-ef0e-49fc-a61a-afb224e8d30b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.790284] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40b9cb25-ef0e-49fc-a61a-afb224e8d30b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.790373] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40b9cb25-ef0e-49fc-a61a-afb224e8d30b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.198638] env[69789]: INFO networking_nsxv3.common.synchronization [None req-a291d146-4b7a-452f-85e7-461cdc0e151c None None] Enqueued Resource ID: 0e66c972-9644-4e96-9986-141ec30d5d1d with Priority: HIGHEST for action port [ 1011.198867] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e66c972-9644-4e96-9986-141ec30d5d1d with Priority: HIGHEST for action port [ 1011.199440] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e66c972-9644-4e96-9986-141ec30d5d1d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.199565] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e66c972-9644-4e96-9986-141ec30d5d1d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.199633] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e66c972-9644-4e96-9986-141ec30d5d1d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.199885] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e66c972-9644-4e96-9986-141ec30d5d1d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.199965] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e66c972-9644-4e96-9986-141ec30d5d1d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.292624] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40b9cb25-ef0e-49fc-a61a-afb224e8d30b [ 1011.292673] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.293706] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.293706] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.293706] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.293706] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.293706] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40b9cb25-ef0e-49fc-a61a-afb224e8d30b already deleted. [ 1011.293706] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40b9cb25-ef0e-49fc-a61a-afb224e8d30b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.702599] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e66c972-9644-4e96-9986-141ec30d5d1d [ 1011.702830] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.702962] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.703111] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.703252] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.703341] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.703698] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e66c972-9644-4e96-9986-141ec30d5d1d already deleted. [ 1011.703698] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e66c972-9644-4e96-9986-141ec30d5d1d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.823668] env[69789]: INFO networking_nsxv3.common.synchronization [None req-d30acd14-952c-4e13-b5e9-3b0af6458622 None None] Enqueued Resource ID: fefd00da-1fa8-4e6e-89a7-81fcbd6a367f with Priority: HIGHEST for action port [ 1012.824212] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefd00da-1fa8-4e6e-89a7-81fcbd6a367f with Priority: HIGHEST for action port [ 1012.824508] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-fefd00da-1fa8-4e6e-89a7-81fcbd6a367f taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.824623] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fefd00da-1fa8-4e6e-89a7-81fcbd6a367f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.824690] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fefd00da-1fa8-4e6e-89a7-81fcbd6a367f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.824990] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fefd00da-1fa8-4e6e-89a7-81fcbd6a367f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.825332] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fefd00da-1fa8-4e6e-89a7-81fcbd6a367f',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.327212] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fefd00da-1fa8-4e6e-89a7-81fcbd6a367f [ 1013.327483] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.327635] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.327714] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.327993] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.328243] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.328243] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fefd00da-1fa8-4e6e-89a7-81fcbd6a367f already deleted. [ 1013.328299] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fefd00da-1fa8-4e6e-89a7-81fcbd6a367f" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.826270] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1017.826574] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1022.827712] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1022.828103] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1023.127716] env[69789]: INFO networking_nsxv3.common.synchronization [req-0d79a1fc-25e4-4866-a1b7-e00ad0029ed6 req-e10e3e96-74f3-4b61-afb3-e4ed9c55f1bd tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_members [ 1023.128467] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGHEST for action security_group_members [ 1023.129302] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.129492] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.129602] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.129901] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.130149] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.130312] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.130411] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.130651] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.130786] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.130933] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.634336] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.634524] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.634524] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.634635] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.655270] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.655513] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.655630] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.655696] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.655892] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.655974] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.656076] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 is going to be updated. [ 1023.681724] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.681912] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.681912] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.682159] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.682298] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.690283] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 in Status: IN_PROGRESS for 2s [ 1025.701662] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 in Status: SUCCESS [ 1025.702083] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 deletion is rescheduled due to dependency. [ 1025.702083] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.813831] env[69789]: INFO networking_nsxv3.common.synchronization [None req-45b9808d-a115-4bd8-8b7a-9f8b97a667b2 tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_rules [ 1027.814362] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_rules [ 1027.814671] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07e7604f-1e6a-4828-9881-43c948f4e494 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.814804] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.814872] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.815183] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.815270] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.879966] env[69789]: INFO networking_nsxv3.common.synchronization [None req-028d5cf5-7466-485b-bb95-4722659c56cb tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_rules [ 1027.880498] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_rules [ 1027.880785] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07e7604f-1e6a-4828-9881-43c948f4e494 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.880888] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.336768] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.336967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.336967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.337264] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.337391] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.337447] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07e7604f-1e6a-4828-9881-43c948f4e494 already deleted. [ 1028.337532] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.337677] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.337837] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.337930] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.859506] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.859942] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.859942] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.860130] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.860130] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.860197] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07e7604f-1e6a-4828-9881-43c948f4e494 already deleted. [ 1028.860291] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.881499] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1032.881754] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1033.534258] env[69789]: INFO networking_nsxv3.common.synchronization [req-9708a9ac-0dea-4545-98ea-d2e45cd39ebb req-d7009f43-4ec6-49d7-a501-1e8e9fb1d58a tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_members [ 1033.534258] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_members [ 1033.534258] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e7604f-1e6a-4828-9881-43c948f4e494 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.534258] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.534258] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.534258] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.534258] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.534499] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.534499] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.534653] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.534689] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.536145] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.817350] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-748 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.817547] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-748" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.817672] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-748" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.817950] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-748" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.818256] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.818394] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.818575] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.818705] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.818847] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.819074] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1033.819189] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.819307] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.819413] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.819542] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1033.819655] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.819792] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.840261] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.840449] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1033.840549] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.840724] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-748" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.841032] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-671fbda7-d5f6-4ff5-b749-205cf559e4cb taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.841212] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-671fbda7-d5f6-4ff5-b749-205cf559e4cb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.841333] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-671fbda7-d5f6-4ff5-b749-205cf559e4cb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.841651] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-671fbda7-d5f6-4ff5-b749-205cf559e4cb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.841789] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('671fbda7-d5f6-4ff5-b749-205cf559e4cb',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.037234] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.037618] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.037618] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.037699] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.037821] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.037977] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.038100] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.038185] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.038313] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.038401] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.038529] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e7604f-1e6a-4828-9881-43c948f4e494 already deleted. [ 1034.038621] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.344150] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.344376] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.344508] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.344814] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.344972] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.345196] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 671fbda7-d5f6-4ff5-b749-205cf559e4cb not found, creating... [ 1034.345477] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.345631] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.345747] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.345970] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.346123] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.346422] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.346575] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.346689] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.346891] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.347033] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.347209] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 671fbda7-d5f6-4ff5-b749-205cf559e4cb is going to be created. [ 1034.367363] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.367575] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.367688] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.367954] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.368196] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.368425] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-671fbda7-d5f6-4ff5-b749-205cf559e4cb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.038147] env[69789]: INFO networking_nsxv3.common.synchronization [req-9708a9ac-0dea-4545-98ea-d2e45cd39ebb req-6eeebeff-cf9f-4045-b277-925c1b60f98c service nova] Enqueued Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_rules [ 1035.038422] env[69789]: INFO networking_nsxv3.common.synchronization [req-9708a9ac-0dea-4545-98ea-d2e45cd39ebb req-6eeebeff-cf9f-4045-b277-925c1b60f98c service nova] Enqueued Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_members [ 1035.038598] env[69789]: INFO networking_nsxv3.common.synchronization [req-9708a9ac-0dea-4545-98ea-d2e45cd39ebb req-6eeebeff-cf9f-4045-b277-925c1b60f98c service nova] Enqueued Resource ID: 671fbda7-d5f6-4ff5-b749-205cf559e4cb with Priority: HIGHEST for action port [ 1035.038665] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_rules [ 1035.038793] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_members [ 1035.038888] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 671fbda7-d5f6-4ff5-b749-205cf559e4cb with Priority: HIGHEST for action port [ 1035.039494] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07e7604f-1e6a-4828-9881-43c948f4e494 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.039585] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.039635] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.039832] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.039914] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.041168] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e7604f-1e6a-4828-9881-43c948f4e494 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.041277] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.041344] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.041513] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.041646] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.041885] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.041885] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.041972] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.042038] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.042129] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.043150] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-671fbda7-d5f6-4ff5-b749-205cf559e4cb taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.043150] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-671fbda7-d5f6-4ff5-b749-205cf559e4cb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.043150] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-671fbda7-d5f6-4ff5-b749-205cf559e4cb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.043150] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-671fbda7-d5f6-4ff5-b749-205cf559e4cb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.043390] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('671fbda7-d5f6-4ff5-b749-205cf559e4cb',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.545599] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e7604f-1e6a-4828-9881-43c948f4e494 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.545738] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.546370] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.546813] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 671fbda7-d5f6-4ff5-b749-205cf559e4cb with status ACTIVE [ 1035.547033] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.547414] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.547414] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.547509] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.547540] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.547709] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.547799] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.548111] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.548111] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.548268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.548364] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.548462] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.548534] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.548665] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.548744] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.548822] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 671fbda7-d5f6-4ff5-b749-205cf559e4cb is going to be updated. [ 1035.569448] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.569587] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.569647] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.569848] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.570089] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.570164] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-671fbda7-d5f6-4ff5-b749-205cf559e4cb" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.051239] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.554119] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.554119] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.554119] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.554399] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.554399] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.554462] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e7604f-1e6a-4828-9881-43c948f4e494 is going to be created. [ 1036.578847] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.579085] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.579085] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.579250] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.579435] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.590264] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e7604f-1e6a-4828-9881-43c948f4e494 in Status: UNINITIALIZED for 2s [ 1038.601523] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e7604f-1e6a-4828-9881-43c948f4e494 in Status: SUCCESS [ 1038.601976] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.601976] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.602120] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.602300] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.602432] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.602511] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.602632] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.602713] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.602802] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.602893] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.105383] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.608624] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07e7604f-1e6a-4828-9881-43c948f4e494: rpc.has_security_group_logging(os_id): False [ 1039.629507] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.629802] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.629802] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.629942] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.630038] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.630261] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.630564] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.630564] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.630564] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.630709] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.630709] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07e7604f-1e6a-4828-9881-43c948f4e494 is going to be created. [ 1039.692136] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.692312] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.692353] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.692582] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.692766] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.704603] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07e7604f-1e6a-4828-9881-43c948f4e494 in Status: IN_PROGRESS for 2s [ 1040.039907] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1040.040112] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1041.718264] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07e7604f-1e6a-4828-9881-43c948f4e494 in Status: SUCCESS [ 1041.718612] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.041689] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1045.042086] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1050.043560] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1050.043560] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1055.044717] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1055.045096] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1060.045757] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1060.046188] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1065.046680] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1065.047131] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1070.049378] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1070.049638] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1075.050377] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1075.050781] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1080.051484] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1080.051824] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1085.052955] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1085.053465] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1090.054506] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1090.054887] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1095.056028] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1095.056460] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1097.541109] env[69789]: INFO networking_nsxv3.common.synchronization [req-0919d89e-5d50-406e-a424-fd3089e9b658 req-25fa616a-80ce-46ab-a61f-17dc706dc7d6 tempest-AttachVolumeNegativeTest-1688662533 tempest-AttachVolumeNegativeTest-1688662533-project-member] Enqueued Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_members [ 1097.541743] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGHEST for action security_group_members [ 1097.542255] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e7604f-1e6a-4828-9881-43c948f4e494 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.542405] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.543182] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.543501] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.543694] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.543848] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.543895] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.544082] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.544177] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.544255] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.047093] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.047293] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.047293] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.047500] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.047594] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.047809] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.047916] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.047990] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.048175] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.048253] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.048341] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e7604f-1e6a-4828-9881-43c948f4e494 is going to be updated. [ 1098.086867] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.087138] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.087239] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.087473] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.087666] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.096271] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e7604f-1e6a-4828-9881-43c948f4e494 in Status: IN_PROGRESS for 2s [ 1100.107020] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e7604f-1e6a-4828-9881-43c948f4e494 in Status: SUCCESS [ 1100.107426] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e7604f-1e6a-4828-9881-43c948f4e494 deletion is rescheduled due to dependency. [ 1100.107426] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.543250] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1102.543630] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1107.544733] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1107.545087] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1112.545825] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1112.545825] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1117.547447] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1117.547765] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1122.548234] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1122.548613] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1127.549167] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1127.549554] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1132.550719] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1132.551171] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1137.552469] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1137.552816] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1142.554163] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1142.554538] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1147.556076] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1147.556076] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1151.062711] env[69789]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1151.062711] env[69789]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c1313f08-0fe8-4088-85e7-f23554d48ea1 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1152.557030] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1152.557030] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1157.558435] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1157.558869] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1162.559405] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1162.559881] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1167.560164] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1167.560551] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1172.560931] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1172.561325] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1175.008266] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.008752] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.008752] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.008834] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.008984] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.510919] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.013284] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.515222] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1176.515470] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1177.351054] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.351403] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.351403] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.351474] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.363060] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1177.363951] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.365138] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1177.389172] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.389345] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.389393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.389582] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.391576] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.391576] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1177.391701] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1177.391701] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1177.414613] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.414855] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.414855] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.415230] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.415385] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.415475] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1177.446699] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.446901] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.446901] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.447131] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.447285] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.447442] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1177.479560] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.479712] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.479836] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.480011] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.480146] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.480268] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:5. [ 1177.480428] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6', '07e7604f-1e6a-4828-9881-43c948f4e494', '6fa29281-8c2a-46fb-8fd2-9726f1c3e301', '03844cb4-294c-44e3-a590-26b53d6fb778', 'ebe3ec3b-ff53-4ea3-bf1f-5938fc203196'} {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1177.480428] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1177.500096] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.500260] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.500329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.500498] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.500581] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.500688] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1177.500762] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1177.500839] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1177.530363] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.530648] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.530709] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.531017] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.531523] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.531694] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1177.531774] env[69789]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69789) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1177.531844] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1177.531926] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1177.531978] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 5/5 resources of Type:Security Group Rules [ 1177.532066] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGH for action security_group_rules [ 1177.532148] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGH for action security_group_rules [ 1177.532210] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGH for action security_group_rules [ 1177.532269] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGH for action security_group_rules [ 1177.532338] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGH for action security_group_rules [ 1177.532386] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1177.532445] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1177.532630] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.532733] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.532799] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.532967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.533055] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.533223] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.533314] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.533373] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.533511] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.533582] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.533735] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.533823] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.533880] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.534019] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.534103] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.534248] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.534332] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.534384] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.534518] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.534586] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.534766] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.534838] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.534868] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.535039] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.535120] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.535278] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.535365] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.535417] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.535551] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.535621] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.535776] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.535863] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.535916] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.536063] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.536125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.536282] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.536369] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.536424] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.536554] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.536642] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.536805] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.536893] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.536946] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.537094] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.537164] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.537321] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.537406] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.537459] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.537597] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.537667] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.537821] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.537921] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.537954] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.538171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.538171] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.538311] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.538395] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.538448] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.538577] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.538645] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.538831] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.538932] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.539007] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.539148] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.539218] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.539489] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.539580] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.539636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.539770] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.539842] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.540054] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.540150] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.540207] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.540340] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.540410] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.540503] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:9 [ 1177.540567] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 9 of least updated resources [ 1177.540642] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGH for action security_group_members [ 1177.540714] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGH for action security_group_members [ 1177.540783] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGH for action security_group_members [ 1177.540842] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGH for action security_group_members [ 1177.540907] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGH for action security_group_members [ 1177.540968] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGH for action security_group_members [ 1177.541056] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGH for action security_group_members [ 1177.541129] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGH for action security_group_members [ 1177.541179] env[69789]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGH for action security_group_members [ 1177.541244] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.561742] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.561861] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=14], Jobs=0 [ 1177.561971] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGH for action security_group_rules [ 1177.562115] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 with Priority: HIGH for action security_group_rules [ 1177.562214] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 with Priority: HIGH for action security_group_members [ 1177.562308] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b3953-c384-4a92-8d77-5aeea593412d with Priority: HIGH for action security_group_members [ 1177.562398] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 with Priority: HIGH for action security_group_members [ 1177.562487] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 with Priority: HIGH for action security_group_members [ 1177.562575] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d with Priority: HIGH for action security_group_members [ 1177.562661] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e with Priority: HIGH for action security_group_members [ 1177.562756] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b with Priority: HIGH for action security_group_members [ 1177.562858] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e with Priority: HIGH for action security_group_members [ 1177.562969] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 with Priority: HIGH for action security_group_members [ 1177.563073] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 with Priority: HIGH for action security_group_rules [ 1177.563158] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e7604f-1e6a-4828-9881-43c948f4e494 with Priority: HIGH for action security_group_rules [ 1177.563244] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03844cb4-294c-44e3-a590-26b53d6fb778 with Priority: HIGH for action security_group_rules [ 1177.563561] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.563682] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.563744] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.563947] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.564043] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.564985] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.565570] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.565570] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.565570] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.565570] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fa29281-8c2a-46fb-8fd2-9726f1c3e301',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.566175] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a60025-1a74-47a6-8a27-9b49e8f20582 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.566283] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.566336] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.566480] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.566627] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.566723] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.566790] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.566908] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.567024] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.567145] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a60025-1a74-47a6-8a27-9b49e8f20582',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.567775] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-367b3953-c384-4a92-8d77-5aeea593412d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.567881] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.567940] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.568116] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.568253] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.568344] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.568398] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.568534] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.568615] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.568736] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('367b3953-c384-4a92-8d77-5aeea593412d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.569866] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b546181-293b-47af-ad81-70b5a00fd2e3 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.570036] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.570036] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.570294] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.570350] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.570410] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.570454] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.570590] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.570666] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.570747] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b546181-293b-47af-ad81-70b5a00fd2e3',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.571638] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.571756] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.571929] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.572078] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.572128] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.572187] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.572230] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.572366] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.572442] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.572522] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ef20af-ee9f-4f45-8eda-e9a89c8415d4',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.573212] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.573317] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.573382] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.573525] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.573719] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.573784] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.573830] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.573925] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.574009] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.574094] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9ea5aa-5019-4bd3-86c8-7647a3bc317d',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.574764] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.574904] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.574976] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.575149] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.575287] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.575384] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.575478] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.575561] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.575636] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.575745] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f997137-cc0e-4d9a-be0a-b38c1cc3f73e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.576586] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79f91b1-6637-404d-83b8-9a172d2bbf3b taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.576646] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.576709] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.576840] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.577091] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.577091] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.577179] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.577255] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.577326] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.577404] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79f91b1-6637-404d-83b8-9a172d2bbf3b',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.578070] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f9994a9-d5bc-4285-9c21-cc72e521d44e taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.578175] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.578241] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.578386] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.578521] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.578753] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.578753] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.578849] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.578904] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.578985] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f9994a9-d5bc-4285-9c21-cc72e521d44e',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.579654] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.579759] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.579843] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.579991] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.580145] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.580228] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.580288] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.580422] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.580495] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.580574] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3334dcf0-49ba-4e8b-90d4-14df2863e5f2',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.581440] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.581566] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.581618] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.581758] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.581842] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebe3ec3b-ff53-4ea3-bf1f-5938fc203196',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.582882] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07e7604f-1e6a-4828-9881-43c948f4e494 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.582989] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.583066] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.583215] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.583288] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07e7604f-1e6a-4828-9881-43c948f4e494',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.584191] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03844cb4-294c-44e3-a590-26b53d6fb778 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.584300] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.584367] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.584511] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.584582] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03844cb4-294c-44e3-a590-26b53d6fb778',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.087815] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.088043] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.088043] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.088233] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.088321] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.088502] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.088598] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.088649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.088817] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.088896] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.088981] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79f91b1-6637-404d-83b8-9a172d2bbf3b is going to be deleted. [ 1178.089855] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.090017] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.090083] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.090237] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.090314] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.090490] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.090659] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.090659] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.090774] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.090848] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.090929] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3334dcf0-49ba-4e8b-90d4-14df2863e5f2 is going to be deleted. [ 1178.091756] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.091887] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.091926] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.092080] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.092160] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.092319] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.092406] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.092468] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.092600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.092674] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.092755] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f9994a9-d5bc-4285-9c21-cc72e521d44e is going to be deleted. [ 1178.093545] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.093649] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.093776] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.093874] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.093951] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.094127] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.094219] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.094277] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.094427] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.094564] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.094606] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f997137-cc0e-4d9a-be0a-b38c1cc3f73e is going to be deleted. [ 1178.095359] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.095465] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.095530] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.095676] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.095794] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.095911] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.096008] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.096076] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.096210] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.096282] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.096365] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a60025-1a74-47a6-8a27-9b49e8f20582 is going to be deleted. [ 1178.097183] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.097286] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.097354] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.097498] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.097575] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.097731] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.097821] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.097879] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.098021] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.098092] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.098173] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b546181-293b-47af-ad81-70b5a00fd2e3 is going to be deleted. [ 1178.098961] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.099075] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.099136] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.099283] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.099358] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.099515] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.099604] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.099660] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.099862] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.099962] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.100065] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 367b3953-c384-4a92-8d77-5aeea593412d is going to be deleted. [ 1178.104539] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.104775] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.104775] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.104957] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.105059] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.105235] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.105331] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.105394] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.105540] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.105616] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.105727] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9ea5aa-5019-4bd3-86c8-7647a3bc317d is going to be deleted. [ 1178.106565] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.106671] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.106755] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.106912] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.106990] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.107184] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.107276] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.107335] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.107471] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.107545] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.107624] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ef20af-ee9f-4f45-8eda-e9a89c8415d4 is going to be deleted. [ 1178.151310] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.151536] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.151536] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.151723] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.153819] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.153928] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.157029] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.157190] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.158985] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.159102] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.168188] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.168322] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.172763] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.172868] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fa29281-8c2a-46fb-8fd2-9726f1c3e301 is going to be deleted. [ 1178.173757] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.173964] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.192055] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.192266] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.192329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.192550] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.192641] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.192744] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f9994a9-d5bc-4285-9c21-cc72e521d44e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.193663] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.193777] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.193846] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.194027] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.194112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.194205] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ea5aa-5019-4bd3-86c8-7647a3bc317d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.194855] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.194966] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.195046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.195200] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.195280] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.195368] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a60025-1a74-47a6-8a27-9b49e8f20582" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.196012] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.196167] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.196239] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.196412] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.196493] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.196584] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367b3953-c384-4a92-8d77-5aeea593412d" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.197232] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.197341] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.197408] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.197588] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.197677] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.197787] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3334dcf0-49ba-4e8b-90d4-14df2863e5f2" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.198433] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.198540] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.198608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.198809] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.198884] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.198992] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f997137-cc0e-4d9a-be0a-b38c1cc3f73e" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.199634] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.199727] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.199800] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.199968] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.200061] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.200153] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ef20af-ee9f-4f45-8eda-e9a89c8415d4" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.200764] env[69789]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1178.201239] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.201370] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.201442] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.201651] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.201744] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.201880] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79f91b1-6637-404d-83b8-9a172d2bbf3b" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.202448] env[69789]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1178.202867] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.202991] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.203078] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.203270] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.203365] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.203474] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b546181-293b-47af-ad81-70b5a00fd2e3" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.206208] env[69789]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1178.206629] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.206777] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebe3ec3b-ff53-4ea3-bf1f-5938fc203196 is going to be deleted. [ 1178.207739] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.207908] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.238632] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.238815] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be deleted. [ 1178.239745] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.239987] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.262883] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.263109] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.264879] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.264997] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07e7604f-1e6a-4828-9881-43c948f4e494 is going to be deleted. [ 1178.265872] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.266095] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.296738] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.296907] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03844cb4-294c-44e3-a590-26b53d6fb778 is going to be deleted. [ 1178.297826] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.298046] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.298137] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.298258] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fa29281-8c2a-46fb-8fd2-9726f1c3e301" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.299042] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.299169] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.299237] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.299395] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.299476] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.299583] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebe3ec3b-ff53-4ea3-bf1f-5938fc203196" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.322099] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.322289] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.322345] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.322534] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.322626] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.322746] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.369734] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.370115] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.370115] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.370268] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.370364] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.370485] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07e7604f-1e6a-4828-9881-43c948f4e494" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.421829] env[69789]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1178.422437] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.422575] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.422653] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.422879] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.423015] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.423152] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03844cb4-294c-44e3-a590-26b53d6fb778" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.477484] env[69789]: INFO networking_nsxv3.common.synchronization [req-d05df0b4-4ded-4bf1-9239-c30ef04eb91d req-8333e1d0-052b-4ce2-94db-8f1023580822 tempest-DeleteServersTestJSON-938478453 tempest-DeleteServersTestJSON-938478453-project-member] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1182.477991] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1182.478338] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.478455] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.478526] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.478720] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.478893] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.478997] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.479207] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.479378] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.479455] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.479553] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.740878] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.741040] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.741135] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.741555] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.741625] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.741773] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.741880] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.742379] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.742379] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.742516] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1182.742749] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.742749] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.742859] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.742960] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1182.743045] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.743177] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.762878] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.763056] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1182.763186] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.763373] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.763678] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-318463f1-256b-4de8-bcbd-55025e35fbb8 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.763850] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-318463f1-256b-4de8-bcbd-55025e35fbb8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.763971] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-318463f1-256b-4de8-bcbd-55025e35fbb8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.764329] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-318463f1-256b-4de8-bcbd-55025e35fbb8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.764515] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('318463f1-256b-4de8-bcbd-55025e35fbb8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.981419] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.981641] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.981641] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.981867] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.981961] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.982172] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.982279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.982336] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.982482] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.982556] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.982639] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be deleted. [ 1183.008650] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.008891] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.008891] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.009075] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.009162] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.009261] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.266616] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.266838] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.266946] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.267250] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.267401] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.267560] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 318463f1-256b-4de8-bcbd-55025e35fbb8 not found, creating... [ 1183.267840] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.267994] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.268121] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.268342] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.268482] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.268764] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.268936] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.269063] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.269275] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.269406] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.269542] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 318463f1-256b-4de8-bcbd-55025e35fbb8 is going to be created. [ 1183.289997] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.290204] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.290297] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.290562] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.290794] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.291049] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-318463f1-256b-4de8-bcbd-55025e35fbb8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.953610] env[69789]: INFO networking_nsxv3.common.synchronization [req-d05df0b4-4ded-4bf1-9239-c30ef04eb91d req-39ed6fef-2acc-4721-8a75-cb8cc4b3a142 service nova] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_rules [ 1183.953871] env[69789]: INFO networking_nsxv3.common.synchronization [req-d05df0b4-4ded-4bf1-9239-c30ef04eb91d req-39ed6fef-2acc-4721-8a75-cb8cc4b3a142 service nova] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1183.953934] env[69789]: INFO networking_nsxv3.common.synchronization [req-d05df0b4-4ded-4bf1-9239-c30ef04eb91d req-39ed6fef-2acc-4721-8a75-cb8cc4b3a142 service nova] Enqueued Resource ID: 318463f1-256b-4de8-bcbd-55025e35fbb8 with Priority: HIGHEST for action port [ 1183.954164] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_rules [ 1183.954294] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1183.954390] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 318463f1-256b-4de8-bcbd-55025e35fbb8 with Priority: HIGHEST for action port [ 1183.954931] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.955152] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.955275] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.955504] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.955628] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.956588] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.956757] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.956868] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.957091] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.957291] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.957446] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.957543] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.957732] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.958464] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.958464] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.959568] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-318463f1-256b-4de8-bcbd-55025e35fbb8 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.959693] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-318463f1-256b-4de8-bcbd-55025e35fbb8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.959772] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-318463f1-256b-4de8-bcbd-55025e35fbb8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.959888] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-318463f1-256b-4de8-bcbd-55025e35fbb8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.959983] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('318463f1-256b-4de8-bcbd-55025e35fbb8',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.461651] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.462744] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.462843] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.463217] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 318463f1-256b-4de8-bcbd-55025e35fbb8 with status ACTIVE [ 1184.463217] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.463369] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.463369] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.463514] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.463604] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.463769] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.463862] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.463925] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.464087] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.464162] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.464333] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.464443] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.464504] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.464644] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.464717] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.464799] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 318463f1-256b-4de8-bcbd-55025e35fbb8 is going to be updated. [ 1184.484806] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.485011] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.485011] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.485356] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.485356] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.485494] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-318463f1-256b-4de8-bcbd-55025e35fbb8" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.967432] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.470143] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.470361] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.470361] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.470593] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.470686] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.470785] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be created. [ 1185.495217] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.495420] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.495464] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.495659] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.495819] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.505209] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: UNINITIALIZED for 2s [ 1187.515640] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1187.515894] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.516051] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.516276] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.516465] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.516587] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.516648] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.516805] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.516880] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.516966] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.517066] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.021086] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.021086] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.021086] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.021086] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.021086] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.021086] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.021086] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.021086] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.021086] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.021813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.021813] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.021813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.021813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.021813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.021813] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.021813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.021813] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.022105] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.022105] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.022105] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.022182] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.524670] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6: rpc.has_security_group_logging(os_id): False [ 1188.542058] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.542260] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.542339] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.542519] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.542622] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.542835] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.542932] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.542996] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.543168] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.543244] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.543411] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.543532] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.543595] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.544201] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.544201] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.544201] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.544201] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.544201] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.544500] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.544500] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.544500] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be created. [ 1188.601259] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.601399] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.601776] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.601857] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.602116] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.613918] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1188.955384] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1188.955560] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1190.627474] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1190.627771] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.956897] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1193.957384] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1198.958382] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1198.958792] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1203.960105] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1203.960514] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1208.961833] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1208.962247] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1212.290710] env[69789]: INFO networking_nsxv3.common.synchronization [req-4eeaa102-dd80-42fc-85e2-9e1bbf3682cd req-73964b36-1eb5-4713-ae68-69315ddb6554 tempest-DeleteServersTestJSON-938478453 tempest-DeleteServersTestJSON-938478453-project-member] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1212.291233] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1212.291561] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.291703] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.291773] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.291989] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.292306] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.292418] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.292485] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.292637] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.292729] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.292819] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.795833] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.796089] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.796204] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.796557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.796705] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.796982] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.797128] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.797193] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.797366] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.797447] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.797547] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 1212.826903] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.827142] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.827142] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.827337] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.827499] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.835999] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1214.847600] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1214.847960] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 deletion is rescheduled due to dependency. [ 1214.847960] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.292279] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.292673] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1220.759714] env[69789]: INFO networking_nsxv3.common.synchronization [req-12ddd636-1049-4c98-b498-22b7887380d7 req-d3cec349-dc58-4de1-9d8b-f4f7069532b4 tempest-DeleteServersTestJSON-938478453 tempest-DeleteServersTestJSON-938478453-project-member] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1220.760199] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1220.760516] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.760733] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.760733] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.760940] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.761093] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.761232] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.761328] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.761504] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.761591] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.761701] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.036115] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.036325] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.036455] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.036734] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.036986] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.037174] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.037290] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.037517] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.037681] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.037899] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.038026] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.038140] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.038249] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.038361] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.038473] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.038603] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.058915] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.059158] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1221.059260] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.059470] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.059783] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-a4a7628c-6272-4835-bee4-d5bd79750438 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.059956] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-a4a7628c-6272-4835-bee4-d5bd79750438" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.060088] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-a4a7628c-6272-4835-bee4-d5bd79750438" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.060456] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-a4a7628c-6272-4835-bee4-d5bd79750438" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.060607] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a7628c-6272-4835-bee4-d5bd79750438',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.265125] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.265125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.265125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.265125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.265125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.265125] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.265125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.265125] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.265611] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.265611] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.265611] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 1221.292244] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.292466] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.292466] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.292654] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.292797] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.302863] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1221.563135] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.563347] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.563439] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.563781] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.563989] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.564177] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port a4a7628c-6272-4835-bee4-d5bd79750438 not found, creating... [ 1221.564446] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.564609] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.564731] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.564970] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.565139] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.565422] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.565580] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.565698] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.565910] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.566062] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.566204] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: a4a7628c-6272-4835-bee4-d5bd79750438 is going to be created. [ 1221.587720] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.587954] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.588067] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.588389] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.588590] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.588815] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-a4a7628c-6272-4835-bee4-d5bd79750438" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.249418] env[69789]: INFO networking_nsxv3.common.synchronization [req-12ddd636-1049-4c98-b498-22b7887380d7 req-22cff012-db85-4c00-aba9-7c367315ff0c service nova] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_rules [ 1222.249751] env[69789]: INFO networking_nsxv3.common.synchronization [req-12ddd636-1049-4c98-b498-22b7887380d7 req-22cff012-db85-4c00-aba9-7c367315ff0c service nova] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1222.249751] env[69789]: INFO networking_nsxv3.common.synchronization [req-12ddd636-1049-4c98-b498-22b7887380d7 req-22cff012-db85-4c00-aba9-7c367315ff0c service nova] Enqueued Resource ID: a4a7628c-6272-4835-bee4-d5bd79750438 with Priority: HIGHEST for action port [ 1222.249954] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_rules [ 1222.250120] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1222.250194] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a7628c-6272-4835-bee4-d5bd79750438 with Priority: HIGHEST for action port [ 1222.250745] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.250874] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.250943] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.251725] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.251797] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.253129] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.253222] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.253792] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4a7628c-6272-4835-bee4-d5bd79750438 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.253912] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4a7628c-6272-4835-bee4-d5bd79750438" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.253981] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4a7628c-6272-4835-bee4-d5bd79750438" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.254211] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4a7628c-6272-4835-bee4-d5bd79750438" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.254266] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a7628c-6272-4835-bee4-d5bd79750438',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.754074] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.754282] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.756480] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4a7628c-6272-4835-bee4-d5bd79750438 with status ACTIVE [ 1222.756666] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.756770] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.756837] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.757090] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.757199] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.757403] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.757582] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.757582] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.757735] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.757846] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.758014] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.758150] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.758217] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.758364] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.758442] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.758527] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4a7628c-6272-4835-bee4-d5bd79750438 is going to be updated. [ 1222.780624] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.780822] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.780822] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.781030] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.781156] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.781320] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4a7628c-6272-4835-bee4-d5bd79750438" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.311501] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1223.311825] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 deletion is rescheduled due to dependency. [ 1223.311825] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.311935] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.312173] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.312391] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.312521] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.312587] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.312752] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.312836] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.312931] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.815763] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.318306] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.820841] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.821069] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.821129] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.821393] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.821511] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.821607] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 1224.848511] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.848718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.848718] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.848895] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.849043] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.857417] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1226.868188] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1226.868559] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.868559] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.868771] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.868955] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.869098] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.869161] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.869346] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.869439] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.869531] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.869624] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.250976] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1227.251183] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1227.371953] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.372213] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.372213] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.372428] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.372664] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.372841] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.372841] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.372970] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.373118] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.373213] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.373359] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.373449] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.373505] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.373646] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.373782] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.373870] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.373921] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.374070] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.374145] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.374222] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.374309] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.878431] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6: rpc.has_security_group_logging(os_id): False [ 1227.898025] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.898025] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.898025] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.898025] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.898669] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.898669] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.898669] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.898669] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.898669] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.898669] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 1227.963600] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.964159] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.964431] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.964859] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.965186] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.978237] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1229.995319] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1229.995695] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.252064] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1232.252426] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1235.615322] env[69789]: INFO networking_nsxv3.common.synchronization [req-08b1713d-265a-432c-b029-8556abf20ca2 req-53a57715-3a02-4520-ab8b-f40dd28edb27 tempest-DeleteServersTestJSON-938478453 tempest-DeleteServersTestJSON-938478453-project-member] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1235.615322] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1235.615322] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.615932] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.615932] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.615932] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.615932] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.615932] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.615932] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.616253] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.616253] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.616253] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.117896] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.118131] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.118131] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.118369] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.118469] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.118674] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.118775] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.118834] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.118997] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.119089] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.119177] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 1236.146505] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.146750] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.146750] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.146883] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.147040] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.155956] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1238.166567] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1238.166567] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 deletion is rescheduled due to dependency. [ 1238.166567] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.616411] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.616780] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1244.174585] env[69789]: INFO networking_nsxv3.common.synchronization [req-d5203fed-57e5-4e26-8555-94994cfa25db req-b42e1997-fdad-4b9d-b8cd-821efb85917a tempest-DeleteServersTestJSON-938478453 tempest-DeleteServersTestJSON-938478453-project-member] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1244.175115] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1244.175415] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.175542] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.175610] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.175793] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.175963] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.176112] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.176198] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.176330] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.176415] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.176507] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.438892] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.439115] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.439678] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.439678] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.439808] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.440063] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.440144] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.440326] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.440510] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.440800] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.440960] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] NeedRegenerationException {{(pid=69789) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.441098] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] no value, waiting for create lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.441211] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] value creation lock acquired {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.441322] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] No value present for key: 'zone-id' {{(pid=69789) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.441428] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Calling creation function for not-yet-present value {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.441561] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.462465] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.462619] env[69789]: DEBUG dogpile.cache.region [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69789) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1244.462752] env[69789]: DEBUG dogpile.lock [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Released creation lock {{(pid=69789) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.462934] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "network-509" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.463273] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock port-1b0effd2-7bf0-4c21-b385-f4fd20590150 taken with stack trace [, , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.463443] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "port-1b0effd2-7bf0-4c21-b385-f4fd20590150" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.463574] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "port-1b0effd2-7bf0-4c21-b385-f4fd20590150" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.463939] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "port-1b0effd2-7bf0-4c21-b385-f4fd20590150" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.464113] env[69789]: DEBUG networking_nsxv3.api.rpc [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b0effd2-7bf0-4c21-b385-f4fd20590150',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.678768] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.678965] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.678965] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.679181] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.679278] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.679474] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.679594] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.679662] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.679823] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.679901] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.679988] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 1244.706194] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.706373] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.706441] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.706602] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.706744] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.717301] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1244.966195] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.966415] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.966544] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.966847] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.967013] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.967177] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Segment Port 1b0effd2-7bf0-4c21-b385-f4fd20590150 not found, creating... [ 1244.967457] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.967617] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.967736] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.967952] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.968100] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.968370] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.968522] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.968638] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.968838] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.968969] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.969118] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Resource: SegmentPort with ID: 1b0effd2-7bf0-4c21-b385-f4fd20590150 is going to be created. [ 1244.989080] env[69789]: DEBUG networking_nsxv3.common.locking [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.989267] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.989358] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.989659] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.989889] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.990119] env[69789]: DEBUG oslo_concurrency.lockutils [None req-661f2486-0500-4ea4-ad9d-4224cd59fd6d None None] Releasing lock "port-1b0effd2-7bf0-4c21-b385-f4fd20590150" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.654429] env[69789]: INFO networking_nsxv3.common.synchronization [req-d5203fed-57e5-4e26-8555-94994cfa25db req-beb5e459-6b9d-44ef-9517-d4f3512b94ec service nova] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_rules [ 1245.654682] env[69789]: INFO networking_nsxv3.common.synchronization [req-d5203fed-57e5-4e26-8555-94994cfa25db req-beb5e459-6b9d-44ef-9517-d4f3512b94ec service nova] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1245.654815] env[69789]: INFO networking_nsxv3.common.synchronization [req-d5203fed-57e5-4e26-8555-94994cfa25db req-beb5e459-6b9d-44ef-9517-d4f3512b94ec service nova] Enqueued Resource ID: 1b0effd2-7bf0-4c21-b385-f4fd20590150 with Priority: HIGHEST for action port [ 1245.655065] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_rules [ 1245.655284] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1245.655460] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b0effd2-7bf0-4c21-b385-f4fd20590150 with Priority: HIGHEST for action port [ 1245.656025] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.656167] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.656231] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.656434] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.656516] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.657371] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.657525] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.657840] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b0effd2-7bf0-4c21-b385-f4fd20590150 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.657954] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b0effd2-7bf0-4c21-b385-f4fd20590150" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.658077] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b0effd2-7bf0-4c21-b385-f4fd20590150" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.658309] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b0effd2-7bf0-4c21-b385-f4fd20590150" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.658422] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b0effd2-7bf0-4c21-b385-f4fd20590150',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.160997] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.161126] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.161378] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b0effd2-7bf0-4c21-b385-f4fd20590150 with status ACTIVE [ 1246.161626] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.161777] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.161902] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.162325] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.162404] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.162620] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.162844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.162844] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.163075] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.163192] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.163452] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.163585] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.163677] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.163879] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.163990] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.164126] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b0effd2-7bf0-4c21-b385-f4fd20590150 is going to be updated. [ 1246.184726] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.184901] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.184939] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.185224] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.185414] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.185628] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b0effd2-7bf0-4c21-b385-f4fd20590150" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.727785] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1246.728087] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 deletion is rescheduled due to dependency. [ 1246.728087] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.728279] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.728449] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.728617] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.728732] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.728795] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.728944] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.729037] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.729132] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.231641] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.734107] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.237056] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.237247] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.237315] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.237608] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.237721] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.237820] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 1248.265696] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.265862] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.265901] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.266134] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.266278] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.274041] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1250.286738] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1250.287154] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.287154] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.287314] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.287479] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.287593] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.287658] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.287812] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.287894] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.287982] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.288084] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.656987] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.657263] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1250.790948] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.791225] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.791329] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.791665] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.791927] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.792108] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.792221] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.792498] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.792657] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.792829] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.793096] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.793260] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.793371] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.793612] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.793846] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.794016] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.794146] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.794363] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.794534] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.794628] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.794802] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.296828] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6: rpc.has_security_group_logging(os_id): False [ 1251.316051] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.316051] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.316051] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.316051] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.316051] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.316398] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.316398] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.316477] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.316600] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.316677] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.316852] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.316944] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.317011] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.317160] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.317234] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.317414] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.317525] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.317584] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.317722] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.317798] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.317881] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 1251.376943] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.377176] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.377176] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.377391] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.377557] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.394413] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1253.413053] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1253.413511] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.657877] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.658291] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1257.974859] env[69789]: INFO networking_nsxv3.common.synchronization [req-856873a2-952c-40e5-a4a8-89d329b0eeb0 req-c61834a9-b725-412c-9744-43c016044fed tempest-DeleteServersTestJSON-938478453 tempest-DeleteServersTestJSON-938478453-project-member] Enqueued Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1257.975127] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 with Priority: HIGHEST for action security_group_members [ 1257.975499] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.975679] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.975789] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.976118] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.976290] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.976415] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.976486] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.976659] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.976748] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.976844] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.479109] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.479331] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.479331] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.479551] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.479662] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.479891] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.480031] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.480098] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.480216] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.480292] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.480376] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 is going to be updated. [ 1258.508258] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.508455] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.508455] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.508631] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.508765] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.517533] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: IN_PROGRESS for 2s [ 1260.529179] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 in Status: SUCCESS [ 1260.529431] env[69789]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6 deletion is rescheduled due to dependency. [ 1260.529472] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ce0e91b-2f8c-4e5c-b9b4-7ec2b50865f6" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.976014] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.976356] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1267.977307] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.977710] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1272.978354] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1272.978354] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1277.979655] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.979966] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1278.879990] env[69789]: INFO networking_nsxv3.common.synchronization [None req-be58da93-0c72-4243-a2ba-d9b3d21f06a8 None None] Enqueued Resource ID: a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7 with Priority: HIGHEST for action port [ 1278.880263] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7 with Priority: HIGHEST for action port [ 1278.880832] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.880958] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.881051] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.881436] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.881436] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.390568] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7 [ 1279.390923] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.391058] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.391201] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.391443] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.391547] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.391653] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7 already deleted. [ 1279.391751] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8c3f4e5-40c3-4ac3-99c2-ccd77a649dc7" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.815138] env[69789]: INFO networking_nsxv3.common.synchronization [None req-199f1d29-9ecc-4e71-9549-795b7acec480 None None] Enqueued Resource ID: b04cba67-479d-441d-bff4-11c4e33377c1 with Priority: HIGHEST for action port [ 1280.815463] env[69789]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b04cba67-479d-441d-bff4-11c4e33377c1 with Priority: HIGHEST for action port [ 1280.815826] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock port-b04cba67-479d-441d-bff4-11c4e33377c1 taken with stack trace [, , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.815967] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b04cba67-479d-441d-bff4-11c4e33377c1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.816052] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b04cba67-479d-441d-bff4-11c4e33377c1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.816316] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b04cba67-479d-441d-bff4-11c4e33377c1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.816400] env[69789]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b04cba67-479d-441d-bff4-11c4e33377c1',) {} {{(pid=69789) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.318733] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b04cba67-479d-441d-bff4-11c4e33377c1 [ 1281.318955] env[69789]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69789) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.319109] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.319244] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.319391] env[69789]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.319480] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.319575] env[69789]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b04cba67-479d-441d-bff4-11c4e33377c1 already deleted. [ 1281.319692] env[69789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b04cba67-479d-441d-bff4-11c4e33377c1" {{(pid=69789) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.817135] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.817591] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.818726] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.819112] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1295.819582] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.819582] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1300.820485] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.820864] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.821971] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.822347] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1310.822887] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.823267] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.823778] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.824285] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1320.824457] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.824810] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1325.826020] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.826427] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.827180] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.827555] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.827805] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.828090] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.829194] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.829641] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.830308] env[69789]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.830614] env[69789]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0